07/19/2012 at 06:00 AM EDT
and Jay-Z didn't stay out long during a recent date night in New York City – but they certainly made use of their limited time out!
Stopping by Bagatelle for about 30 minutes to celebrate rapper pal and former rival
Nas's latest album, Life Is Good
, during the debut of the Moet Rose Lounge 2012 series, the new parents
arrived just before midnight.
"They made their way through the packed restaurant to the VIP section," a partygoer tells PEOPLE. "The guys chatted away and enjoyed laughs, while Beyoncé danced to [the honoree's] forthcoming album."
Upon leaving the 200-person party, the A-list pair exited through a side entrance. – Carlos Greer