Why are you shamed for simply not being attracted to a race?

I'm attracted to white men, Asians and some mixed Latinos (not too dark though). I'm not attracted to certain other races because I'm not just simply not attracted to them.

Someone from one of those races I wasn't attracted to once called me unfair for not giving him a chance. According to him I was a racist too. Why? I'm in my right to feel attracted to whoever I want to. Why are you shamed for that or even called a racist?

Updates
+1 y
I'm only guilty of simply feeling no attraction towards that guy.
Why are you shamed for simply not being attracted to a race?
Post Opinion