"I have my kids every Friday through Monday, and I don't leave them the whole time I have them," Barker told PEOPLE Thursday at the Remy Martin Spirit Unleashed launch at Smashbox Studios in L.A. "I stay with them the entire, entire time. I don't go out to lunch with a friend and leave them with anybody else. "
Barker and Moakler have two children together – Landon, 4, Alabama, 2 – and stepdaughter Atiana, 9, Moakler's child with Oscar de la Hoya.
"I'm obsessed with my children. I'm only [at the party] today because I have to stay busy. After work I have to keep my mind off them because I can't be with them."
As for his current relationship with Moakler, he says it goes up and down. "I don't have the best relationship with her but it's a work in progress. I think it will get better if we learn to be friends. We absolutely, absolutely, absolutely love each other. I think it's more that we have different ideas on how to raise children, and that can like break down the walls of love as far as I’m concerned."
Barker’s philosophy for raising children stems from his own childhood struggles. "My mom died when I was 16. I had a rough childhood, you know what I mean, but it made me strong … I want a certain thing for my children. I just want to be in their life. I don't want nannies raising my kids."
With Mother's Day around the corner, Barker doesn't let any bad blood change how his family marks the day. "I'm going to take my kids to the cemetery to visit my mother, and we all do something for Shanna. We always make something for her."
As for the future for the on-again, off-again couple Barker isn’t optimistic about a reconciliation, "I don't think so. I think that has gone way too far, but I think there's hope to be really, really good friends and parents."
Reporting by JENNY SUNDEL