"I'm going to do one more," the Country Strong star tells Access Hollywood. "I signed up for two ... so I'm excited!"
Paltrow, whose character stepped in when glee club director Mr. Schuester came down with "monkey flu," says the whole experience of filming an episode of FOX's hit show was a blast.
"Just the incredible challenge of getting off a plane, going to record four songs immediately in one afternoon, and then having to learn all the dance numbers in like 20 minutes," she says of what she enjoyed about the stint. "I love Ryan Murphy. He's an old friend of mine and I was just in awe of everybody's talent and getting to work with Jane Lynch, and Matt Morrison is so adorable and all the kids – it was just great. It was really fun."
And the feeling is mutual. Paltrow, who performed the songs "Forget You," "Nowadays/Hot Honey Rag" and "Umbrella/Singing in the Rain" on an episode that aired in November, made quite an impression on Mark Salling and show creator Ryan Murphy, who told PEOPLE Paltrow is "just the best."
While Paltrow's daughter Apple, 6 ½, most definitely agrees with that assessment, she also took a liking to another Glee star.
"My kids came out [to the set] and my daughter fell in love with Heather [Morris] who plays Brittany," Paltrow says. "Whenever she sees a Glee thing she's like, 'It's Heather!' "
There's no word on when Paltrow's second episode will air.