The downside from a user's perspective is that attempts to withdraw your funds would be rate limited by the same algorithm.
As long as the default is hot storage and people have to opt in for warm storage (much like Coinbase does there vault), I think this would be a great feature to add.
I agree with your opinion @lukestokes