Money is not the only metric of value. What the hell does he care? Are you causing undue suffering in someone by taking a job that pays less? Is he expected to take up the slack financially or something? I can't see how it's any of his business at all.
Money will buy you things but it will never buy you more time with your family or true satisfaction.
He doesn't have a lot of hobbies. And I would NEVER ask him for money and his daughter and grandkids are fine. Some people just like to be crabby. But it's honestly no big deal. I didn't mean to make it sound like I was up nights worrying about it. Just made me think about how sometimes people misunderstand each other.