says he and Angelina Jolie
are going to need a bigger bed – for their expanding brood.
"We're not done," Pitt, 43, quipped, acknowledging public interest in the family's growth
. "They say, 'Any plans for a fifth?' And I say, 'And a sixth, and a seventh, and an eighth, and a ninth.' That's my answer."
"We also made a 9-foot-wide bed" that fits him, Jolie, 32, and all four children, Pitt who is starring in The Assassination of Jesse James by the Coward Robert Ford
, told the Associated Press. "Just big enough. One more and we'll have to go to 11 feet."
The Jolie-Pitt clan already consists of four kids, all born in Asia or Africa: Maddox, 6, Pax, 3, Zahara, 2, and Shiloh, 1. And, while one parent works in front of the camera, the other takes time off to look after them.
"We just take turns and make sure we keep the family together," Pitt said, adding in an interview with USA Today
, "It's impossible for us. We're run out of every major city. There's just too many paparazzi. There's always cameras in the kids' faces, yelling their names."
Although he doesn't pack a six-shooter like his latest screen character Jesse James, Pitt admits he's concerned about "how to survive and how to maintain a family life."
"I understand the essence of paranoia. I understand being hunted, to some degree. It's rare, but there are imbalanced people out there. I've had break-ins in the house," Pitt said. "I've had some of these abnormal incidents that can be a bit frightening.
"It's something that I want to be aware of and be cautious about, especially with the family, that everybody's protected," he told the AP.
The Assassination of Jesse James
opens in limited release Friday and netted Pitt the best-actor award at the Venice Film Festival. The family's current base is New York because he is shooting the Coen brothers' flick Burn After Reading
Who's turning 40? Which celebs are high school dropouts? What's hot and definitely not in fall fashion?
Check out PEOPLE's new digital magazine now!