Oh, I agree.
Again, the position is not one of "Does not push."
The fundamental disagreement, is one of "Any pushing is seen as too much."
Again, this comes back again to previous statements I have made, concerning how to approach people. When you immediately jump to that conclusion, you shut out any potential for changing their view, even a tiny bit. You instead only reinforce that view, and then, having done so, give them a saucy anecdote to tell their grandkids, about how dangerous and bad the trans people are.
If instead, you open your dialog with "I understand that you think I am a dirty pervert. That I only want to use this bathroom to trap some poor woman in here, and then rape her. I understand this. It is not true. Instead, imagine if one day, you were a man. No, I do not mean "you lust for women"-- I mean, you wake up one morning, just as you currently are, in every way--- except, this morning, you need to shave your face, have heavy bone structure, and yes--- those. Would you not wish, very much to have your old body back? That feeling is what every day of my life is. The only difference, is that I was never permitted to be pretty to begin with." There is SOME chance that you will melt that icequeen's heart, just enough, that she stops thinking of you as Mr Rapeface.
Doing so however, requires understanding those irrational fears. Acknowledging them as real. And trying to forge a commonality with the person that holds them.
You do not get there via echo-chamber isolation, blocking people who hold such views so you dont have to interact with them, or worst of all, painting them as monsters.
What they do is monstrous-- but they do so out of fear. (Either loss of power, loss of identity, or loss of safety-- it does not matter. It is still out of fear.)