I don't think the downvoters care about rep. They may care about accounts that hold large amount of SP as the accounts that do can retaliate back with downvotes (I;m not one of them).
In either case, this topic just got hit with a bunch of downvotes.