The key difference isn't what people invest in (or spend their money on) it is excess capital.
If you don't have money left over after survival then you can not invest.
If you don't have time left over after working to survive then you can't generate extra capital.
The ruling class have long tried to limit the working class leisure time, and unions had to go on strike to limit working hours, which current lobbyists are even today trying to over turn.