There's always more to "need." I think the problem with owning a home isn't always the loan. It's usually the cost of keeping up with everything else, the unforeseen this or that. Add kids and there is always some way to "better" spend the money.
If I sell the kids however, I think I could maybe work this strategy in.
However, the difference of a pizza month can be the difference between a 30 year loan and a 20 year loan. There are always things to spend on, but I also think that for most of us, there is a lot of wastage too and often on things that don't bring that much value.