I genuinely think that if a brand new word had been coined for this, there would have been a lot less pushback and objection.
Or maybe some people just whine too much.
That's true--and I will just out and out admit that this is also me.
But I, too, struggle with the word: privilege because I don't see it as 'privilege' but as the way things should be for all people. It should NOT be seen as a privilege to be able to walk through a department store without being followed because you are presumed to be a shoplifter. It should NOT be a privilege to expect your child or your spouse or your friend or yourself to be able to drive (legally, obeying traffic rules, etc) or walk to wherever you need to go without being stopped by police and having your life at risk because you are the 'wrong' color. Or get a job/scholarship/place in a school or on a team, etc.
We ALL like to believe that we earned our place in school, our scholarships, our jobs, our place in society on our own merit. Largely, we did, at least if you grew up on the lower end of middle class like I did, without much in the way of family wealth or position or influence to smooth any bumps you encountered.
But too often, we are so busy congratulating ourselves on achieving whatever successes we have achieved to see how many others who are as intelligent, well educated, hard working, decent people do not get the jobs/scholarships/school admissions/jobs or basic freedom to walk into a store or drive down the road unharassed solely because of the way they look or their gender or who they love, their religion, their culture, their primary language, and more.
At least in this country, we tend to believe that we all have earned our place and if your place ain't so hot, well, that's on you for having a certain coloring or eye shape or hair texture or gender or religion or primary language or whatever is used, consciously and not, to deny people the same access to what is good in life--including the safety and space to just exist.