I think the issue is everybody associates a flag with having "broken the rules" which is somewhat problematic since there are no official rules. However each individual has their own standards of what they deem valuable or potentially damaging to the network. It's only human nature to react emotionally when somebody expresses that what you're doing is "abusive" or "bad" or even "unintentionally harmful". But we have a system where I believe we need to be free to express that when we feel it.
Otherwise people just leave quietly (and many people have).