Demis Maryannakis / Splash Online
10/11/2013 AT 07:30 AM EDT
Dean Sheremet learned that his wife
cheating on him
when she told him in a phone call.
The dancer-turned-chef, who
divorced the country singer
in 2009, told
's Billy Bush on Thursday that he was blindsided when he learned that she was cheating on him with her married
"I never saw it coming," he admitted.
Sheremet, 32, revealed that Rimes called to tell him a magazine "may or may not have a picture of me and Eddie kissing."
He was shocked and asked, "What do you mean, 'May or may not have a picture?' What does that mean?" he told Bush and co-host Kit Hoover. "It unfolded from there."
Sheremet never imagined his wife would cheat on him. "You have that assumption that the person that you're with would never do something like that," he said.
moved on and married
photographer Sarah Silver, 37, in August 2011, four months after Rimes and Cibrian tied the knot. He admits that he and his ex haven't kept in touch.
"We don't really talk that much," he said. "There's not really a need to. I don't really know what we would talk about."
When asked if it bothers him to be asked about the situation two years later, Sheremet says no.
"It's fine because I've really laid low during the whole thing. It's part of my story and it's the reason that I get to do awesome cooking segments. Whatever it is that gets me in the door is fine. I'm really a chef!"