I hate being seen as a threat

Talking to women, theres an invisible membrane of distrust. This is understandable, because men are often dangerous to women. But I'm not dangerous to women. I know theres no real solution to this, but it really bothers me. This is one of the very few ways that being a straight white dude really sucks. For example, a few weeks ago I was talking to a transgender acquaintance and they said they were afraid to be openly trans around me. They looked at me and made that assumption. Which, again, is a matter of survival, but it still makes me feel like shit. If only they knew me better, no one would be afraid around me. It sucks because people are afraid I'm some sort of predator, when I've never done anything predatory in my life. I wish I could just be who I am, withoutthese preconceived notions clouding everything. Again, I know there's no solution to this, but it still makes me feel gross and shitty.