Can I remove Mouse4 shortcute

I had this issue in crusader kings with no solution, hoping it isn't the case here. Mouse4 is my push to talk button so I would really love if it didn't just take me to whatever I last clicked on.