Street battles don't achieve the thing you want however. That's a false dichotomy between ignoring them, and hitting them on the head with bats.
Charlottesville would be a long forgotten minor even if not for the swarms of protestors, ensuring it became a worldwide media circus. I'm sure a lot more conservatives heard about all of the groups involved because of the spectacle.
Similarly, Patriot Prayer's entire strategy is built around getting a reaction from Antifa. It's the basis of their formation, and their entire business strategy. The guy who formed it said he did so in response to seeing videos of left-wingers beating up Trump supporters after a rally back in 2016. That's proto-Antifa right there, assigning the Nazi label to the half of the country who "vote wrong".
This is how you lose them folks, when you label half the nation as Nazis, and not just actual flag-bearing Nazis, you water down what a Nazi is. If you say all Republicans might as well be called Nazis, you make actual Nazis seem more palatable. Hell, Trekkin here wouldn't even back down from labeling moderates as might-as-well-be-Nazis last time I pushed him on it. If you throw around the Nazi label as a blanket statement then you do in fact desensitize people to it, and you make it like if you're called a Nazi you must be "doing something right" to get the attention.
That's why you play into the right's hands when someone says something fairly innocuous such as "there are only two genders" and you call them a Nazi over it. You're basically giving them the game (and Laci Green got called a Nazi over much less than that).