Maybe it's also hard to argue because he regularly expresses those sorts of views. I'm really not sure why people are coping so hard about this, it's pretty obvious what his beliefs are if you've watched his content for any amount of time.
Because society defines those views as "Nazi" and people opposing society's anti-white agenda frame their opposition as "Nazi" in turn as a form of rebellion if not "venting".
I don't agree with the Nazi framing, use of swastikas, etc. anyway because it's dumb, inaccurate, and shortsighted to frame reasonable gripes against anti-white agendas and mass immigration as if they're specifically sourced from a German political movement of the 20's and 30's that's in practice defined by starting a war over ethnic German territorial interests at the expense of Slavs (read: other white people) and having borderline religious antisemitism that resulted in a deranged genocide.
As I said prior Jews seem to be overrepresented as anti-white bad actors, but that doesn't mean most or all Jews are enemies. This is the core disagreement I have with "Nazis", in addition to their general racial policies being too extreme.
In Italy, for example, Jews were very well-integrated and many were even Fascists until Mussolini sucked up to Hitler and adopted antisemitic policies which alienated them, as well as other party members and the average Italian.
The association of general European/white nationalism and to some degree ethnonationalism in general with "Nazism" is more or less entirely the result of George Lincoln Rockwell's American Nazi Party. Rockwell flat out admitted he "retconned" generic white nationalist views as "Nazism" and used Nazi aesthetics as a ploy to get media attention by causing controversy in the 1960's. "Neo-Nazis" follow this trend started by him.
Regardless even between general white supremacy of the 60's and earlier (which I agree was too extreme) and what we can support now there is a middleground.
This is a silly argument, just because someone doesn't go batshit at every jew doesn't mean they're not a nazi. Even the nazis had Jews who were given honorary aryan status.
Only thing I can say here is that it's pure speculation on your part that Sam is an "anti-semite" to the same degree that Hitler was. I don't believe that, and I just think that, at least in the past, he quite simply didn't care enough about having coherent optics on the subject.