You are, of course, correct that gold is not very rare.
And you have, of course, heard the adages:
Money is power
Gold is the only real money
So, as long as people still use money and there are people who have an unquenchable thirst for power, then these people will be looking to amass more gold. Even if they have more gold than "all the gold in the world".