I'm the same way. A lot of purists say that the PC-Master race is the best and it's tough to argue with them when it comes to ASDW controls and pinpoint accuracy aiming with a mouse. Controller players don't stand a chance against keyboard/mouse users in FPS games. That's a big part of the reason why I don't play them.
I want gaming to be relaxing just like you described above. If things get too tough, I quit. There was a time in my youth that I would take the time to get better at a game but these days? Good lord the games are tough and no, I am not going to dedicate that much time to them.
I never completed Wind Waker and I regret that. I was one of those people that was pissed that they changed the graphical style and therefore shunned it.