"I love kids, I love working with kids, I love being around kids," he said at the Noble Awards in Beverly Hills on Sunday.
And daughter Harlow enjoys being a big sister to 1-month-old Sparrow James Midnight, who was born in September to Madden, 30, and Nicole Richie.
"She loves it. She's so happy, she's just psyched," he said. "She totally gets it. It fit in perfectly there – hasn't been a hitch."
In fact, it's even easier than the first time round.
"Well, one, it's a boy – so you're not as precious," he said, "so he's going to be a little tougher."
But Sunday night, it was all about the award Madden was receiving for his work with The Art of Elysium – though it was more important to him that it was presented to him by his children's mother and her father, Lionel Richie, while his twin brother, Benji, watched.
"They are just as much a part of it," he said. "Nicole does just as much as I do with Art of Elysium and all the charities we work with. And so does Benj – Benj actually does more then I do, and he plays the guitar better then I do, so he is a little more entertaining for the kids."
PeopleTV Archive: Watch Nicole’s Style Evolution