I think if we can walk away saying, I did the right thing, we can't truly be the losers, not really. Above all, I have to like who I am, and what I do, and this is the same for you.
If you showed your a good neighbor, that should fuel your sense of worth, and if you don't neighbors don't' or can't see it, it's says a lot about them. That's all...
Cheers my friend