"But most of these limitations are in people's own heads."
Nowadays it is easy enough to study part-time online, either formally or informally. Having a job already can help to pay for tuition fees or even starting a business.
But I would just add that it isn't necessarily true for people in more desperate circumstances and countries.