I think of it more as a certain kind of persons reaction to a certain kind of situation. There is certainly nothing wrong with them and it's also pretty grey and only seems black and white because labels make it black or white.
I can relate to a lot of your experiences at school. As one of these people, I do agree it's a gift and I've disregarded the label completely because I don't benefit from it. It says more about society than it says about me.