These devices keep your private keys off the line which significantly increases your security and limits the chances of your currency being stolen.
I think "off the line" is key here. Hardware wallets can also be breached , but the required effort to do so is a lot higher due to also having to control the physical device.
Alternatively a paper wallet might also do the trick.
Yes, I thought about adding a section about paper wallets here but chose not to.