Is there anyway to change our character avatar without losing our progress?

TSW3 is my first TSW. I chose "that guy" when I started TSW as sort of a joke. Two months later and I have become hooked by this game and well...the guy is kind of a bummer to look at. He seems like he hates his profession. I want to change the avatar but it looks like I will lose progress if I do. Anyway around this? Xbox Series X