The Batman v Superman star told the U.K.'s Sunday Times that he thinks there's a "double standard" when it comes to flirtation.
"I mean, if a girl shouts something like, 'Oi, love, fancy a shag?' to me as I walk past, I do sometimes wonder how she'd feel if a builder said that to her," Cavill told the newspaper. "Although, of course, I wouldn't feel physically threatened, as she might."
While Cavill, 32, isn't necessarily shy about showing off his good looks, the actor said that he doesn't like it when women openly approach him in front of girlfriend Tara King.
"I've heard some things in my time, I have to say," he told the Times of amorous fans. "I'd best not say what. I don't mind it – not unless I'm with my girlfriend and someone is being complimentary to me in order to disrespect her. People who don't respect other people's feelings really get my goat."
Watch: The Many Looks of Henry Cavill
Cavill and King, 19, have been dating since at least October 2014, when they were spotted together in London.
He told Elle of the relationship, "When I met my girlfriend, I was super intimidated. I wanted to impress her. I was thinking, Don't mess this up, man."
Cavill added to the Times of being in touch with his feelings – especially in regard to King – that, "everyone should be entitled to their full range of emotions."
"Whether they display them in public or not is a different debate, but, um – sorry! – yes, the acknowledgment that people feel things is important, on both sides of the, um, sex fence," the actor said.
While Cavill seems to think he's met his match, he does ultimately admit that "the pressure that comes from dating someone in the public eye is enormous."