How exactly would that work? Would you lose your SP? Your ability to downvote others? How would they "destroy" your account?
I'm asking from experience. I was attacked by someone with a much higher stake than me not once, but now three times. Did you three manage to destroy my account already?
I'd guess not.
And another thing. If they are on your side, wouldn't you think they'd be cheering you on and joining your crusade?