I did some tests using Proton VPN and I don't think there will be a case where my single Privex server is better than cloudflare! It was often quicker before though for the avatars.
I've turned off proxying the images now. Sometimes my back end downloads and caches them anyway when generating QR codes with images server side.
But the clients now pull them direct and its noticeably more performant especially on this demo page which loads avatars while you select an account. It's quite a good work out for the back end.