A xenophobe isn't someone who follows master race ideologies, most xenophobes are ignorant rather than bigoted or afraid. A gang of Neo-Nazis or a conquering nation would not be "xenophobic" but an isolationist type person or someone who dislikes outsiders would be a xenophobe