's children were born into privilege, but they'll learn about those less fortunate, the actor vows.
"It's a hard thing to explain to a kid," Damon said at San Francisco fund raiser for the OneXOne children's charity Thursday. "And it is also unbelievable the way other kids are forced to live."
Damon, who's known for his charity work
, said his daughters may well accompany him on some of his overseas missions.
"The way you have to parent them is to show them the world. Explaining the world can only go so far," he said. "You can read about devastation every morning – it's on the front page of the newspaper – but when you actually go there and see it, you realize this isn't something you can turn the page on."
Damon is the sole male in a household of four females. His wife,
Luciana, gave birth to their daughter
, Gia, over the summer. She joined big sisters Isabella, 2, and Alexia, 10.
"It's great," Damon said about being outnumbered at home. "It is really great."
Reporting by JAMIE FROEHLING