Now I don't feel guilty at all
That's great - guilt spoils so much enjoyment. I completely sympathise about the dust, it's everywhere here and there's more building work to come.
Generally now, I only have what I'm currently working on. I've got much better at selecting what I want to knit and both the big projects (the jacket and the blanket) are using wool from my stash. I keep a little mindless project (currently a pair of cosy socks for lounging) for when I have nothing else at the right stage of mindlessness for the knitting group. Anything complicated, you either make a mistake or miss a crucial bit of gossip 😂.