Excellent explanation of Cognitive Dissonance. I like the quote by Aristotle that "it is the mark of the philosopher to entertain a thought without accepting it."
Ideally, we should live by the philosophical tenets of the Bayesian inference. Where no hypotheses is ever 100% and we should always change our assumptions based on new data.