"I'm going to be honest – I'm not exactly a hands-on dad," Cowell tells Hello! magazine about caring for his 8-month-old son, Eric Philip.
"I want to fast forward a few years so I can take him go-karting and then introduce him to women," says the music and TV producer, 55.
"I'm probably in a far better position to be a father now than I would have been 10 years ago," he tells the magazine. "That's the way I'd look at it. And at the end of the day we have really great nannies that are bloody amazing, so I don't have to worry."
Despite his unconventional remarks, Cowell has said he "was born to be a dad," and that he wouldn't rule out having more children.
And while the former American Idol judge is also considering marrying his girlfriend and Eric's mom, Lauren Silverman, he's currently enjoying being "the only iconic bachelor left in the entire world – thanks for that, George Clooney!"
He adds, "I've never said 'no' to marriage, but then again, I couldn't imagine having a kid at one point and now look at me."