Male taste in men and female taste in men are not the same. Straight men and most gay men think muscle bound manly men with chiselled jaws are the hotness. Lots of women like KPop androgynes. Lots more men be ‘mirin a guy who has big muscles than women.
Even taking this into account, it's still possible to determine or sense the attractiveness of most attractive competitors. At least to the point where sexual attraction cannot be the sole criteria