The singer, 21, who's been spending time in the tropics, visited the ancient city – a favorite tourist destination on the Yucatan Peninsula – on Thursday.
"I can confirm to you that Mr. Bieber was kicked out of the Tulum archaeological site yesterday," Adriana Velazquez-Morlet, director of the Mexican National Institute of Anthropology and History told Entertainment Tonight. "He and his mates pulled his pants down and insulted our staff at the site."
"We have a very strict policy of conservation and respect of the Mexican cultural heritage that applies equally to all our visitors, whether or not they're famous," Velazquez-Morlet added.
Additionally, a Mexican official told the Associated Press that Bieber apparently attempted to climb onto or among the ruins.
Visitors can scale some pyramids at Tulum, but officials rope off or place signs prohibiting touching or climbing those that are considered vulnerable.
Info Quintana Roo / Splash News Online
Officials at the site called police, but everyone had calmed down by the time they arrived and no further action was taken.
A rep for Bieber did not immediately respond for comment and site officials could not be reached.