I would implore you to take some time and have some deep reflection on why you feel this way. It is very not normal. It's almost borderline envy, in my opinion.
Edit: Like I think it could be evolutionary also in a sense that they challaenge my pitiful masculinity with their very presence.
I don't think this is evolutionary in any way. Your statement is implying that your masculinity and their masculinity is in some sort of race when it may truly not be at all. Just because they are better looking than you doesn't mean you are less; it just means they're better looking, period, end-of-story, nothing else more.
You could very well be decent-looking but just not as good as them and this wouldn't equate to you being less. Lastly, being good-looking is not the end-all-be-all to life (same as having a big dick).
I think you may have some deep, emotional personal issues that needs to be worked out. I would recommend professional help to unpack all the baggage you may have been carrying for all this time.
Good luck. Other people's mere existence should not "challenge" who you are especially if their existence has little or no affect at all to your own very existence from an objective point of view.