Raven-Symoné Was Body-Shamed at 7 Years Old on The Cosby Show Set
07/30/2015 AT 09:00 AM EDT
"It was definitely hard," said the former child star, 29, on Tuesday's episode of The View. "I remember not being able to have the bagel or anything at – we would call it crafty, where it's just a table of food, ready for you to eat whatever you want. And I remember people would be like, 'You can't eat that. You're getting fat!' I'm like, 'I'm 7! I'm hungry!' "
Though Symoné didn't divulge who made those remarks to her, she admitted that comments about her weight really upset her over the course of her career.
"I'm not going to put them on blast, but that's what I was told at that young of an age," she said on the show. "Even up until I got up to 180 lbs. on That's So Raven, you put nasty stuff in front of me, or you put images of these women that I’ll never aspire to, of course I'm going to get depressed."
The actress, who retired from the spotlight at 27 before returning to TV also emphasized that weight is based on much more than what you're eating.
"It's more than just the food – it's what's in the food, and it's your cortisol level and it's your serotonin level," she continued. "That has a really strong effect on your body type."
Symoné recently told PEOPLE that even though she may come off as super confident now, she still battles with insecurity.
"Maybe I just know how to hide it a little better," she said. "I'm like, my insecurities? Lock them in a closet until I get back home. Put on an extra pile of makeup or a girdle and let's go."