Tapering down off latuda and starting Zoloft and hydroxyzine. Looking for similar situations.

So heres the whole story in a summary. Psychologist thought I may need a mood stabilizer and I think I just need anxiety meds. Went to see a psychiatrist and told them what the psychologist said and they wrote me Latuda 20mg without much other investigation. This was an online type psychiatrist. Was doing ok on the 20 mg and psychiatrist said we should increase to 40 mg and see if we could be even better. Well that changed everything. That brought intrusive thoughts and serious depression so I started halving it. I didn’t realize it was extended release and so I was essentially negating taking it. I called the psychiatrist and he stepped me back down to the 20 mg so I stopped cutting it in half and started taking 20 mg again correctly and have been taking it correctly for 2 weeks now. Ended up going to ER and was prescribed Xanax .25 mg a couple of days ago. It quietened my head and the intrusive thoughts are quiet now and today I went without the Xanax. However the depression has been excruciating up until today when I had a better day. Went to a new doctor today and she wants me to taper off the latuda 20 mg and start taking it every other day for 7 days and then every 3 days for 7 days and then stop. At the same time she wants me to start 50 mg Zoloft and take 25mg of hydroxyzine up to 3 times a day as needed and I can keep my few Xanax for any breakthrough panic attacks that may come or just bad anxiety. I’m nervous about all of this transition and how it will affect my mind which doesn’t need anymore. Anyone have a similar situation? New dr said she agrees I shouldn’t have been on the latuda to begin with.