Do it a little bit slower, it's your brain being confused about your orientation due to fast movement.
The goal here is to activate the muscles that squeeze your eyeballs when focusing. Doing it a little slower gives the same effect but will take longer.