It is a huge paradox, nobody agreed to democracy in the first place. Why voting? Who is the ultimate authority here?
If the voter has the authority, then there is a problem since you can only vote for limited options, the "no politician" option is never on the ballot.
If the government has the authority, then it's a circular logic, since what gives the government a right to rule over us?