I’d differentiate between xenophobia and racism. Being weary of something different is very different to feeling hate or acting against it.

A lot more people than would like to admit are a little bit xenophobic, but not racists.