"That happened especially a few years ago when I became a vegetarian and started to take care of my body and mind more than I used to [...]." I noticed a similar issue when I started getting into shape years ago. I think people come to expect you to be a certain way and when you stop being that way it makes them uneasy.
Anyway, good post.