In my expereince, responding to downvotes with retaliatory downvotes doesn't end up well--even if you have more HP than them.
Next thing you know there is a downvote war that degenerates.
Small users have to hope that a big user comes and saves them.
At least the downvote use is limited by the system.
There's always some hope in a dark situation...