Gender is a bit like color. It involves a spectrum. We can use a few names for primary colors, or we can use many names, as in a paint store. Gender is even more complicated than color, because the gender spectrum is multi-dimensional. There is no perfect way to segment it, and adding more names doesn't help.
I agree with you. We can quibble endlessly about how people use language, but we have more important problems to deal with.