In an interview on SiriusXM's Music Row Happy Hour, the country star admitted that, over the past few years, he's had to learn to ignore the naysayers.
"The last couple of years, year and a half, I kinda had to dial it back a little bit," he said, laughing.
When the host asks if there was an intervention for Shelton's Twitter responses, the country singer, 39, said there wasn't but at some point he just decided he couldn't "get worked up" over it anymore.
"At first it was fun for me to get on there – I don't know that anybody has as many haters out there as I do, at least in the country music world – I think that's what was fun about Twitter for me, to get down there and be like 'oh, really,' and just fire back at em," he said.
Shelton continued, "Next thing I know, that became a popular thing for people to look at on my Twitter page, just me firing back at the booger-eaters out there. After a while … I just decided, man, I can't get worked up over this stuff anymore."
Blake Shelton on His Social Life: 'I'm a Slug'
Completely understandable, as the Voice judge has a lot more positive things going on in his life – like new girlfriend Gwen Stefani.
"Gwen thinks of Blake as the biggest blessing," a source close to the pop singer told PEOPLE after the couple made their red carpet debut at the Oscars. "They share both good life experience, like work, and bad ones, like their divorces."