Exactly. Even if you know precisely where things are when "tidy" there is still the pause to retrieve it and then return it to it's designated location.
For me the glass not in use is stored under my workbench, it's an organised system but other than the clear glass (that I use the most and know I will have to continually retrieve from the storage) I don't have the time mid way through a project to stop, put it in the kiln, find what I need, get the piece back out the kiln and then bring it back to working temperature. Aside from the time inefficiency it's also impractical.