Judging people without really knowing them is a ingrained skill in the human toolkit that was used in the past to defend ourselves but these days is not that useful and ends up causing issues, the way to go is to try and rationalize it and not base your life relationships with other persons based on your early judgements, which will happen doesn't matter who you are and instead teach yourself to get to know other people before labeling them.
This is not an easy job but if you are able to do it you'll learn to navigate the waters of life with a little bit more of confidence.