Paul Simon and Edie Brickell leave court in Norwalk, Conn., Monday
Elder Ordonez/INF (2)
04/28/2014 at 04:30 PM EDT
and wife Edie Brickell were arrested over the weekend.
New Canaan Police told PEOPLE Monday that the two were "arrested and charged in a family dispute," after officers responded to a call to investigate a family dispute around 8:20 p.m. on Saturday.
"I got my feelings hurt and I picked a fight with my husband. The police called it disorderly. Thank God it's orderly now," Brickell, 48, tells PEOPLE in a statement through her lawyer.
The Grammy-winning singer, 72, lives in New Canaan, Conn., with musician Brickell, whom he married in 1992. The pair have three children together.
Brickell is perhaps best known for the debut album by Edie Brickell & New Bohemians, called Shooting Rubberbands at the Stars
, which featured the hit song, "What I Am."
The couple appeared in Norwalk Superior Court on Monday.
Reporting by CARLOS GREER