Harry, allegedly attempting to be funny, delivered the line in November, when black comedian Stephen K. Amos performed at the 60th birthday of Harry's father, Prince Charles, according to Amos, who appeared Tuesday on the U.K. chat show The Wright Stuff.
At the time, recalled Amos, "I wanted to say, 'How is I supposed to sound?' "
'Racist Stereotyping'Reaction to the exchange has been strong. "Many young people will be disgusted by his remark," said Naomi Byron, national secretary of Youth Against Racism in Europe, reports the U.K.'s Daily Mirror.
"But it is not just Prince Harry that is at fault," she is further quoted as saying. "The aristocratic, rich circles he moves in obviously don't have a problem with this kind of racist stereotyping."
Added former Commission for Racial Equality chairman Lord Herman Ouseley: "It is very sad that Prince Harry thinks black people all talk in the same way. It just goes to show how ill-educated members of the upper classes can be."
No CommentA spokeswoman for Harry tells PEOPLE, "We don't comment on allegations about private conversations involving the prince, and we are unable to confirm whether it did or did not take place."
Contacted by PEOPLE, Amos's agent also had no comment, as the office has not been able to talk to the comedian.
2005: Prince Harry dresses as a Nazi soldier
2002: Harry gets caught smoking marijuana