I don't so much think it's other riders judging you for what you wear, but us transferring over our frustration from all the **** WE have to deal with because of what you do. You ride around thinking your actions have nothing at all to do with the rest of us, and the rest of us get annoyed at your ignorance for the headaches you can cause us. As much as you think it's just you and your bike against the world, the rest of the world looks at all of us as the same.
Once you move out of your parents house and start interacting in the real world you'll see how your actions affect everyone else around you and it'll make more sense to you. I think it definitely sucks when people refuse to set a good example because they're too busy taking care of themselves to picture things on a greater scale.