Why is the term DEI is only ever used towards women and non-white men?

I never see this term being directed towards a white men or anyone questioning a white man's skill set for a given job. However, whenever a female (includes white women) or a minority male gets a highly skilled job or goes to a prestigious school, I often see this word being thrown around a lot to undermine said person's accomplishment.

"You are a DEI. You only got into this school/job to fill a quota and not base on merit"

Why is the term DEI is only ever used towards women and non-white men?
Post Opinion