When I was a kid, I never saw Islamic-style headscarves worn by anyone in my town. I first saw one a few years ago. Now I see them all the time. And it bothers me. Does that make me a racist?
Islamic headscarves are indicative of ideology. If a Muslim woman believes in Islamic ideology, she will wear a headscarf. A headscarf is one of the few publicly visible signs of Islamic devotion. And if she believes in Islamic ideology, she will probably have lots of children and indoctrinate her children with the ideology too (Islamic texts encourage fecundity and indoctrination).
But I'm not a bigot or a xenophobe, and here's how I can tell: When I see a Hindu woman in a headscarf, it doesn't bother me a bit. Hindu ideology is not dangerous to non-Hindus. When I see a Buddhist monk, I don't feel concerned. If I saw a growing number of Buddhist monks in my town, it wouldn't bother me at all.
And I'm not a racist. If I saw more and more Japanese people in my town, it wouldn't disturb me at all.