Then how can we be "anti semitic?"

Se·mit·ic: relating to or denoting a family of languages that includes Hebrew, Arabic, and Aramaic and certain ancient languages such as Phoenician and Akkadian, constituting the main subgroup of the *Afro-Asiatic* family.