I had a look for USB powered heaters and there are loads! But it would seem they are not so effective. Better for warming your fingers than a whole room!
You can also run a mini fridge from a USB. Amazing.
By the way, if you are interested I have added the answer to my question as an update at the bottom of this post.
It turns out I need a step up converter.