Ok, so as a British white guy who's lived in the UK most of his life, I've lived both sides of the coin.
I've seen blacks and Asians disasadvantaged and racially abused, and worked at a company which prided itself (and was likely instructed to) in providing equality.
I've lived in areas of town and cities domitanted by whites, and later by Asian and black communities. Both have played the race card, and both have contained people who are not interested in colour or creed.
I agree that exclaiming white privilege is inherently racist, but feel there's no smoke without the fire - hopefully it's a fire that is going out as we globally merge.
I think most people are in this mindset @abh12345, stuck between a rock and a hard place. It's undeniable that certain groups have faced and continue to face varying levels of inequity in certain situations. Those need to be addressed and oftentimes, race does become a central pain point.
But when the first step from that sensitive topic is to drag in an racially-charged overgeneralization, the majority (in this case, 'white' people) feel as if their empathy or even extended helping hand is being spat at.
I think it isn't a coincidence that this type of rhetoric is getting stronger/louder as the world becomes more global. There's a greater platform for these thought-niches that were previously seen as over-emotional responses and sometimes completely irrational. The concept of "white privilege" is the latter for me and it puts us in a tough situation as there is really no way of appeasing the 'minority condition' with such aggression.