Yeah, but if that person is a powerful lunatic trying to disrupt politics in your country for his own gain, then you might want at least to keep an eye on it.
Is he, literally, a "Nazi"? No, he's not literally a Nazi.
Did he proudly do a salute with Nazi / fascist connotations twice? Yes, clearly.
So I think that him not personally cranking up the gas chambers isn't really the issue here.