You aren't asking anything, you are demanding that male and female labels remain rigid, when in reality, they aren't as rigid or as convenient as we'd prefer.
Male and female are pretty concrete concepts.
It’s curious that humans had no difficulty distinguishing men and women up to our present time. Now there are folks who display a cognitive deficit in simple pattern recognition. Is it something in the water? The soy?
No, I think it's probably some sort of perception bias. There's probably a term for it, I just don't know what the term is.
Male and female humans are quite dimorphic, and sex is perceivable in an
unaltered human with a very high degree of accuracy based on tertiary and secondary sex characteristics. Contrary to the assertions by some, you really do NOT need to see someone's genitalia to determine whether they are male or female. But there are in existence people whose tertiary, and even sometimes secondary, characteristics are ambiguous or fall into an uncertain range. For example, there are males who are small-statured, fine-boned, with narrow shoulders, and little to no body hair. They might be mistaken as female if they're fully clothed. Alternatively, there are females with small breasts, narrow hips, angular facial features, who are unusually tall and might be mistaken for male if they're fully clothed. But those are outliers, and generally speaking, the visual indicators of sex have an incredibly high accuracy rate. Humans can tell an unaltered male from an unaltered female with over a 99% accuracy. That's a phenomenal fit.
But... there are a couple of things that skew perceptions. For one, we have an ideological push that insists that sex is a spectrum and is really hard to tell. That belief tends to promote visual images of people who appear androgynous. Because those visual images are used so much and are so prevalent, it distorts perception of how dimorphic humans really are. It should be an easy reset: leave the internet and go to the grocery store or to a mall. The sex of any adult who walks past is pretty obvious, even if they're all wearing neutral gendered clothing. This is the same kind of thing that happens with news and media always showing the negatives and the bad things happening, it gives people the false impression that those negative events are commonplace and prevalent, rather than exceptions. Which also leads a lot of people to be pretty depressed and pessimistic about the world. But if you shut of the news and actually go out into the world, it's really not as bad as media makes it out to be.
The other thing that is happening is that some people are altering their visual cues. If someone takes exogenous cross-sex hormones, it will change some of the most common indicators of sex - breasts and facial hair. If you add in padding and shaping clothing, stuffers, and cosmetic surgery that alters the shape of the face or throat, it can obscure those innate indicators of sex.
So even though sex itself is a very concrete, clear concept, and is NOT a spectrum... people end up conflating visual secondary and tertiary cues with real biological sex, and they also end up putting too much emphasis on the exceptions and the altered images, so that they end up being perceived as more common than they are.