Simon Cowell Says He Told Louis Tomlinson to 'Man Up' When He Heard Baby News, Says One Direction Taking a Break
07/19/2015 AT 03:25 PM EDT
The music producer, 55, said he told Tomlinson, 23, to "man up" when he learned that he was expecting his first child with friend Briana Jungwirth.
"I said to him, 'You man up. You’re fortunate because you're in a position to be able to look after the baby and not worry too much about that,' " Cowell said. "But I also told him, 'I've received bad calls in my life but this is not one of them. This is your business but I'm here for you.' "
Cowell reiterated that the news, which PEOPLE revealed on Tuesday, should not be taken as something unfortunate or negative.
"He didn't kill anyone. He got someone pregnant. It happens every day all over the world. Again, Louis has got great family around him and, look, it's a plus, not a negative."
Indeed, a source previously told PEOPLE that the singer's family have been rallying behind him and Jungwirth, 22, and that the expectant parents' families met and bonded over the July 4 weekend. Tomlinson also plans on buying a home in Los Angeles, where Jungwirth resides, so he can be closer to her and his unborn child.
Cowell also suggested that One Direction might be ready to take a break.
"In terms of the band, they've got enough hits now they can take some time off and do some other stuff they want to do," he said. "Then I hope they'll have a little bit of time apart and want to get back together again. It's a fun job, but it’s absolutely their decision."
The band has been dogged with rumors that they will be splitting up ever since Zayn Malik left the group in March. However, a source told PEOPLE in June that the group would likely not officially break up but take some time to pursue solo careers "just like the [Rolling] Stones."
"The boys know that by sticking together they can still pursue everything they want to do as a foursome, as well as individually,"the source said.
Cowell also confirmed the news that Malik had been dropped from his Syco label, which is part of Sony:
"Well, because it was his decision to leave the group and we hadn’t asked him to do it, I felt my main responsibility was to the band. They didn't ask for it to happen either and I did sign One Direction as a group.
"But luckily within Sony there are a lot of labels who are really good. I had a feeling there was one particular label who would love to have him and they did," he said.
Cowell added, "It also means no one has any nerves about whether we're working harder on them or him."