Would you apply that same reasoning to the skinheads, nazi's or biker gang that wants to frequent your favorite swimming pool.

Not as to the first two (I have nothing against people who ride motorcycles). I despise Nazis, and my understanding of what it means to be a "skinhead" (as opposed to just a bald person) is that they are Nazi supporters or sympathizers. I am willing to commit - quite publicly - that people who are Nazis are bad people. And there is a very good argument as to why they are bad people. One absolutely has a right to not like interacting with bad people. That doesn't make you a bad person.

Notice the difference there. With Nazis, you're not being repulsed by who they are, but by they fact that they support a genocidal ideology. That makes them bad people. Trans men and women are not bad people. They're not Nazis. They have no attributes that are analogous to supporting the genocidal extermination of minorities. There's no moral dimension to justify being made uncomfortable by trans people's presence. That's generally what we mean when we refer - colloquially - to being "intolerant" in these types of situation. It's wanting to diminish or reject people without having a reason. That's why someone who hates black people is a bigot but someone who hates mass murderers is not, and why we would commonly refer to the first person as "intolerant" but not the latter person.

Albaby