I think most people are in this mindset @abh12345, stuck between a rock and a hard place. It's undeniable that certain groups have faced and continue to face varying levels of inequity in certain situations. Those need to be addressed and oftentimes, race does become a central pain point.
But when the first step from that sensitive topic is to drag in an racially-charged overgeneralization, the majority (in this case, 'white' people) feel as if their empathy or even extended helping hand is being spat at.
I think it isn't a coincidence that this type of rhetoric is getting stronger/louder as the world becomes more global. There's a greater platform for these thought-niches that were previously seen as over-emotional responses and sometimes completely irrational. The concept of "white privilege" is the latter for me and it puts us in a tough situation as there is really no way of appeasing the 'minority condition' with such aggression.