I primarily use the secondary market when purchasing junk silver or specialty rounds (like Golden State Mint).
I never gold and never buy standard government silver (ASE, Maples, Krug) or Big Mint Silver (Kooks, Pandas, Lunar) due to the potential for counterfeiting.
I did at one time, but no more.