I get it. But the trouble is you must then decide which "higher power" you believe in. Therein lies the rub. Since different religions make contradictory claims about the identity and nature of such power, how is one to choose?
If all religions agreed that such matters were simply up to personal preference, there would be no problem. The problem is that many religions insist instead that followers must convert others. Short of violence, converting others to your way of thinking is quite difficult when your claims are unfalsifiable.
I think it just comes down to your beliefs. I am a christian and one of my biggest take aways has always been that its not my place to judge anyone else. If you believe in a different god/no god/set of morals or norms its not my place to judge you but to treat you the same way I would anyone else. If there is a higher power up there its his job to sort things out, not mine.