I am still new, August 1, 2017. So I am still learning and trying to remember the different terminology used. The person may only be downvoting a Post, but it does affect the posters account and rep. I know because I was downvoted without cause very early on by bernie and his house of 52 cards, (52 down votes), that did affect my reputation. Fortunately I knew about cheetah, steamcleaners, and @timcliff, and they fixed things for me.
But yes when it is strictly a money/reward issue, it is not always the posters fault.