The Oscar winner and wife Camila returned to their home of Austin over the weekend for the second annual Mack, Jack & McConaughey fundraiser, a two-day event he, musician Jack Ingram and football coach Mack Brown hold to raise money for five local children's charities.
And Camila, 32, said she's thinking her children (Levi, 5, Vida, 4, and Livingston, 16 months) may head to school in the Lone Star State instead of Hollywood.
"It's possible that we do that, that the kids grow up here and go to school. It's different here than in other places, and we really like it," the model and designer told PEOPLE. "It's more relaxed and easy here. It's our home and we love it. It feels so good to be back here with our good friends and family."
A few years ago, the McConaughey clan purchased a house on the shores of Lake Austin to be closer to the actor's mom, Kay McCabe, who also attended the weekend's fundraiser. McConaughey mostly grew up in Longview, Texas, but Alves said Austin holds a special charm for the low-key couple.
"The people really take care of us here and they treat us like regular people," she said, explaining that the family recently ate lunch at an outdoor food trailer court. "The children played and played forever outside, and no one came up to us and no one asked for pictures or anything. … Everyone protects us here and lets us just be us."
He wowed as fellow Texan Ron Woodroof in Dallas Buyers Club, but McConaughey's biggest role is that of a full-time father.
"Matthew really loves the children, and I would say he's a very hands-on dad, he's very involved," Camila said. "That's why we all travel together and that's really important to us, to be all together, everywhere we go."
Reporting by KELLY RONDEAU