Jeff Probst Feels 'Guilty' About His 'Spectacular' Home

10/12/2012 at 02:45 PM EDT

As the host of Survivor Jeff Probst spends a lot of time in exotic locations, but he feels grounded – and lucky – to live at his estate in Los Angeles.

Walking around the 10,000-sq.-ft. abode with PEOPLE, Probst, 51, says the property is so "spectacular" that he "feels guilty, at times" that he's able to live there.

And he shares the house's glittering history: "This home," he says, "was owned and built by the late great Gene Autry."



Probst, who also recently launched his own daytime talk show, lives in the house with his wife Lisa Ann Russell, 41, and her two kids, Michael, 8, and Ava, 6, from Russell's previous marriage.

"Outside is the best part of the house," says Probst, walking out onto an expansive brick patio and showing off an enormous pool.

"This is most definitely the house Survivor built," he adds, "and I owe [producer] Mark Burnett a giant thank you for putting me in a situation to be able to live in a house like this."