No. But you have to check periodically that the witness you had voted is still active. Because if a witness misses block validation severally, he/she will be deactivated by the system. This is more reason why we must make sure that those we vote for as witnesses are capable of living up to expectations.
You can check if your witnesses are still active by visiting https://steemd.com/witnesses