"Goy" is actually just short for Goyim, meaning gentile, non-Jew, or "person of a nation" (since Jews are supposed to be a diaspora, and don't ask me how Israel fits into that context unless you want me to go full puzzle piece). It is not actually or necessarily racist or anti-Semitic.
Some people have accused Jews of being racist simply because the term exists, even though it is not derogatory (it can be used that way, but so can almost any term for any group of people) and doesn't even refer to any particular race or religious group. It's about as "racist" or bigoted as military folk using the term "civilian."
That being said, Nazis love doing this sort of thing and appropriating shit and twisting it, especially stuff from Jews. See also: the gold stars. The Star of David isn't just an identifying symbol, it's literally supposed to protect Jews to wear it. The star wasn't necessarily more prevalent than, say, chai, the Hamsa, or the tree of life before the war. If anything, chai might have been better for the purpose of identifying Jews since six pointed stars can be used in a lot of contexts that have nothing to do with Judaiism. There are a number of Jewish spiritual symbols but the Nazis chose that one in particular to rub it in that the symbol that is supposed to protect us was actually going to mark us for death.
And so of course now Jews wear it constantly and have chosen it as our main symbol because fuck Hitler, we're still here.
I haven't kept up with the latest Neo-Nazi dog whistle bullshit, so if they're now using Goy to fuck with Jews, well... Of course they fucking are.
