Of course, I know all this. I don't think it's the same thing as a form of address such as Mr. or Ms., however. In a neutral situation where, for instance, you are dealing with a co-worker, that's totally fine. But when it comes to personal attraction, that's a hard no for me.It’s not a minefield.
It’s no different than getting someone’s name wrong and having them say “that’s not right, my name is John”. It’s not a gotcha.
If someone says “don’t call me a man” there are literally an undefinably large number of ways to just not use “man” (or guy, or dude, or bro). Nobody is trying to catch you out or looking for a reason to correct you. It’s just a basic thing to refer to someone in the way they prefer. Like how some Women for **decades** have preferred maritally ambiguous titles like Mz instead of Mrs or Ms.
Instead of “you’re a handsome man” you could just say “you’re beautiful” and everything would be fine.