Hahaha!! I use this word a lot.... I use it more in writing than it talking actually because of this same reason:
It's words we use when we don't know what to say; when we're searching for the right word.
Didn't know that actually makes you look sound stupid... I don't know what to right now, I like this word. I feel like it's part of my character.
Well, I'll try to use it less... only when it matters.
What are some examples of times you use it in writing?
Searching my comments section I found a recent one.... I think I don't use it as much as I remember.