Yeah, I agree. That really would help! Like the user below my comment described, he wants to avoid being flagged yet doesn't understand why people get flagged; The reason is that there really are no rules or guide lines for how to use the flag.
If it was changed to downvoting then no one would take offense and everyone would just understand it is an opinion.