06/17/2011 at 04:30 PM EDT
Her storyline on Glee
as sexy substitute teacher Holly Holiday
may have wrapped up with a bittersweet farewell last season, but Gwyneth Paltrow
was back in action with the McKinley High crowd Thursday night at the show's tour stop in East Rutherford, N.J.
The actress, 38, made a surprise appearance at the concert, which was being filmed for the upcoming Glee Live! 3D!
Singing Cee Lo Green's "Forget You" – an anthem that seems to be her go-to since she performed it
on the Fox show, Saturday Night Live
and the Grammy Awards
– Paltrow palled around with the Glee
stars on-stage, even sharing a shimmy with Chris Colfer.
Jane Lynch also made a cameo at the show, alongside regulars Lea Michele
, Cory Monteith
and Mark Salling.