08/02/2012 at 04:30 PM EDT
Been there, done that.
That's how Joey Lawrence seems to feel about Dancing with the Stars
– as the actor, 36, says he declined an invitation to return for this fall's all-star season.
"I did it. It was good for me," Lawrence told PEOPLE at Wednesday's Los Angeles premiere of Total Recall
. "We got to the end there, and it was down to me, Emmitt [Smith] and Mario [Lopez], and it was good."
Smith, 43, won that third season
in 2006, and he is back for the all-stars show – which Lawrence says he doesn't really understand.
"Emmitt apparently feels the need to have another mirror-ball trophy," he says with a laugh. "It should be all runner-ups. I don't think any champions back in the mix makes any sense. If you don't win, then you've done worse than you did the last time ... I think to throw champions in the mix is weird, unless it's all champions."
Lawrence, who was paired with Edyta Sliwinska and finished third in his season, is rooting for someone in particular this time around – another Joey.
"Joey Fatone is a friend of mine, and he went out the same time that I did," Lawrence says. "He went out third [in season 4], so I would love to see him win this time around."