Yes, that's absolutely true. In fact there's a yogic text that I refer to always in my mind - there's four types of people, and one of them you just have to distance yourself from, all compassion aside. If it's alright for the yogis, it's alright for me.
And compassion only goes so far - you can understand where people are coming from and why they are like that, and try your best to shake them out of their behaviour, but sometimes those sheep tracks in their mind are so well worn you just have to nod your head and go along your own sheep track.
Trailbreaking one's own path is often the way to go, especially when that path moves away from negativity, be it a person or situation.
I know you don't mean Yogi Bear here, but the same could be said I think. 😆