Yes, I have always manually curated, but it definitely seems possible to set up your account to copy the voting habits of a curator account - so if they downvote you, then all the other accounts would automatically copy that downvote too I assume.
Perhaps I have been lucky so far - I mainly share live music or surfing photos... People have been nice to me!