Garner, 43, has kept busy working on the set of her latest film, Miracles from Heaven, while weathering claims that the family's recently employed nanny, Christine Ouzounian, had an affair with the Oscar winner.
Multiple sources told PEOPLE Ouzounian, 28, confirmed her romance with Affleck to friends, telling one pal she is "in love" with Affleck after their tryst purportedly began this spring.
Affleck, 42, vehemently denies the claim, explaining they had "a work relationship and a friendship," but things never got physical.
Garner and Affleck announced their split on June 30 while on a family vacation in the Bahamas. Shortly after, the family has spent significant time in Atlanta while she is in the midst of filming.
Although Garner is said to be "livid" about the scandal, she has stayed composed in public, even finding time to make a surprise visit to an Atlanta hospital last Sunday to visit a young fan battling cancer.
Affleck has kept a low profile since the nanny scandal broke, although a source close to the actor said he's been in Atlanta this week along with their three children.
Ouzounian, meanwhile, was spotted out in Los Angeles Wednesday – the same day news of the scandal broke – and is now said to be holed up at the Hotel Bel Air.
Affleck made the upscale hotel his unofficial L.A. home following the split, with one friend telling PEOPLE he and Ouzounian would meet there discreetly.