This sounds reasonable, but the logical conclusion of that is that the only people that associate with Nazis are other Nazis, or future Nazis (who may not realise it yet). This normalises nazism in a growing group of people because they don’t have any moderate voices highlighting their more extreme thoughts and pulling them back towards normality.

Your argument also make the false assumption that Nazis are irredeemable. I’m sure some of them are. But I’m equally sure that at least some of them aren’t.