It could also be mitigated later by making a SP threshold for downvotes.
Example:
- Anyone with over 20,000 SP cannot downvote or their downvote is worth less than a "commoner".
You might want to think of things like this to prevent flag wars. It has happened and can in the future... Especially if someone like Facebook buys a huge stake in Steem while prices are low to censor.