It does appear to have been the boost install. I probably didn't sudo those in the first attempt.
Update: Nope, I got the same build error, eventually. I'll keep poking at it.
Update: I got it to compile on my Raspberry Pi by adding swap:
sudo dd if=/dev/zero of=/var/swap.img bs=1024k count=2000
sudo mkswap /var/swap.img
sudo swapon /var/swap.img