10/14/2013 at 04:30 PM EDT
saga may have put Robert Pattinson
on the map, but not all of Hollywood is looking for that type of attention.
Following the announcement that the Sons of Anarchy
actor exited Fifty Shades of Grey on Saturday
, a source tells PEOPLE it wasn't all because of his "immersive TV schedule," which Universal Pictures and Focus Features blamed for his departure.
"He dropped out of the project because he didn't want to be typecast," the source says. "He didn't want the Robert Pattinson
-esque attention that would come along with taking on this role."
Announcing the news of Hunnam's exit, Universal Pictures and Focus Features released a joint statement that read, "The filmmakers of Fifty Shades of Grey
and Charlie Hunnam have agreed to find another male lead given Hunnam’s immersive TV schedule which is not allowing him time to adequately prepare for the role of Christian Grey."
That same day, Hunnam, 33, served as the best man in a friend's wedding.
He "seemed in really good spirits and spent time with his closest friends and his girlfriend," a source said at the time
, adding that he gave a sentimental toast to the bride and groom.