I think within reasonable limits, it's ok to worry, but if it becomes too much and excessive the negativity associated with it would be more pronounced.
Most times, the things that push us to worry are things we have little or no control over, hence can do little or nothing about hence "misusing imagination"
"Worry is a misuse of imagination!"
I love the quote, I would do well to remind myself whenever I am worried.
Thank you.