Downvoting is apart of the website and it doesn't always mean that you are being attacked as many seem to think. I think the terms "downvote" and "flag" need to be separated.
For me, when I hear flagging, I think of someone that had done something wrong. While a downvote doesn't mean that you have done anything wrong but maybe a post is over valued at the current amount.