"The story is complete garbage and full of lies," a rep for Affleck says of Us Weekly's report that Affleck and Ouzounian, 28, who began caring for the couple's children (Violet, 9, Seraphina, 6, and Samuel, 3) this past spring, struck up a relationship after Affleck and Garner were separated but before they announced their divorce. "It's shameful. We are considering legal options."
Ouzounian, who has also nannied for Neil Patrick Harris, is employed at a high-end Beverly Hills babysitting agency. The report claims that she was let go after several months of working with the Affleck family, but she and Affleck remained in contact and she was photographed visiting him in L.A. on July 17.
Garner and the Batman v Superman: Dawn of Justice star announced their split on June 30 after celebrating their 10th wedding anniversary.
Affleck has strongly denied accusations of infidelity, but several sources close to Garner allege that Affleck told Garner he had not been committed to the marriage within the past few years, and the allegations of infidelity along with other troubling behavior (drinking and gambling) helped lead to the marriage's end.
"She loved Ben," a close friend of the actress told PEOPLE. "But there comes a time when you have to say enough is enough and take care of yourself."
Despite the breakup, the exes have been putting on a good face for their kids. Affleck has made several trips to Atlanta, Georgia, where Garner and the children are staying as she films the drama Miracles from Heaven.
The stars were spotted out together in the Southern city last week, and they continue to wear their wedding rings in public.
Reporting by ELIZABETH MCNEIL