That's actually a very interesting question. I would definitely want to have more vivid images too, but I get what you are saying, and I agree. Some people would just hate the idea of going back to a place that made them feel bad, or even miserable.
As I said, it's not only positive memories that come back, but I feel like it would be interesting to research more about it.
Definitely a topic we should learn more about, that's for sure.