Precisely!
The funny thing is that, in general, these masses of conspiracy theorists and the whales, orcas, and dolphins that support them are in favor of free speech and prefer to challenge someone's ideas rather than simply attacking them.
That means that the malicious down-votes (those not targeting fraud, plagiarism, violence, etc.) pretty much exclusively come from one end of the pool... and for the "equalization" of down-votes to occur would just mean a whole lot less rewards for all sorts of creators - and even more centralization of stake for the whales.
Great point! So free speech is great, until a whale or curation group doesn't like it.