It’s like this: you’re born into a world where, upon maturity, everyone gets a pet elephant which is invisible to everyone but themselves. Society is structured around the needs of peoples’ elephants. People talk about the elephants and their foibles incessantly. The mass media includes the elephants in every story ever as major plot points. Until you hit the age where you get your own elephant, you can’t see them, but you’re assured that you’ll get your own when you grow up and then you’ll understand everything.
So you grow up, you reach the Age of Elephant Acquisition, and… no elephant. You infer that elephants exist–after all, people keep insisting they must, and people your age have started talking about their elephants and how wonderful and interesting they are, and also people with fairly unusual elephants are willing to do truly baffling things for the elephants’ sake. Probably, you think, the elephants exist, but you’re not sure, because you’ve never experienced anything that seems like an elephant of your own, and couldn’t it be possible that this is some sort of elaborate plot or mass delusion or something?
But people keep insisting that the elephants are totally real, and everyone else your age has started talking about how their elephants are doing. And you’re seriously the only one who is confused by the elephants thing, so you maybe try to casually bring it up–maybe you sort of try to ask people how their elephants look in casual conversation, because it’s possible that you do have an elephant and you just haven’t noticed! Possibly they are in fact very small and hard to see, but they cause a lot of mischief! After all, sometimes funny rustling things happen around you, too, just like they do to people who do have elephants. So you try to ask around, in case it’s something that you can miss, or you’re not interpreting things right, and you look very hard for things that can be interpreted as being sort of vaguely elephantine. But when you do ask them, people give you funny looks and treat you as if you’re stupid for asking, because duh they know what an elephant looks like. Everyone has one! All you have to do is look, it’s not like they’re hard to see!
You see how this can become frustrating.
Eventually you assume you are, in fact, different and not just unobservant, and try to construct the image of what an elephant looks like so that you can understand properly. But no one who has one will sit down with you and answer your questions and help you understand, even if you’re really stubborn and you ask a lot of people a lot of questions. You end up having to construct your understanding of the elephant from tiny snippets, little bits of information you can coax out of normal people before they get aggravated and change the subject. And of course everyone emphasizes different parts of what the elephant is, because everyone is different and thinks about things differently, and you have to try to pick at the distortions as best you can.
That’s what it’s like, being asexual and trying to define sexual attraction on its own. Or being aromantic-ish, and trying to define how romance works. I suppose being agender and trying to suss out gender identity is similar, and I bet there’s other parallels to make. The thing is: you don’t have something, and you’re trying to understand how it works, and no one who says they understand will try very hard to teach you what it’s like.