Kody Brown and three of his wives
05/11/2012 at 05:00 PM EDT
When you have four wives and 17 kids, planning a special Mother's Day can be something of a production.
star Kody Brown, 44, will have a doozy of a special occasion on his hands this Sunday, celebrating with his four wives: Meri, 41, Janelle, 43, Christine, 40, and Robyn, 33, as well as their combined 17 kids.
"Mother's Day is a great day at our house," says Brown, who divides his time between his wives and kids in their four separate houses in Las Vegas. "We want to spend it as a family and make it so my wives don't have to cook."
Kody and Robyn welcomed baby Solomon
in October, further cementing the family's ties after Robyn and her three kids Dayton, 12, Aurora, 10, and Breanna, 8, joined the Brown clan, whose show returns to TLC
on Sunday (9 p.m. ET).
"My kids now have three moms and a father who loves them and is involved with them," says Robyn. "They are adjusting and learning a lot about sharing and being in a big family. All in all, there have been growing pains, but they have enjoyed it."
Brown says all the kids – who range in age from 17-year-old Logan (his son with second wife Janelle) to little Solomon
and 2-year-old Truly (his daughter with third wife Christine) – are learning a lot and growing together.
"The children I had with Meri, Janelle and Christine grew up in a plural relationship," says Brown. "Robyn's kids are in a blended family relationship, which is very different, so this has been a growing experience for all of us."
Brown admits it's not always possible to connect with each of his kids every day. "I struggle to do it daily, but I don't struggle to do it," he says. "I feel connected and they benefit a lot from my being open and kind."
First wife Meri says that have sought help to maintain their happy plural marriage. "We've all gone to marriage counseling, just to learn how to communicate with each other and to learn other people's ways of communication," she says. "It is something that is always evolving."
Brown says the women in his life carry a huge responsibility. "Our family would not work without the devotion and commitment of these four mothers," he says. "They deserve the credit for being devoted to our relationships and for making this all functional."
The Browns' new book, Becoming Sister Wives: The Story of an Unconventional Marriage
, will be released Sunday.