questions on removing the speaker arms on valve index.

so i'm thinking of removing the speaker arms on my index. don't get me wrong the speakers are great but i'm looking for a more isolating experience that can only come from over the ear, closed back, passive and active noise canceling headphones, and the arms are in the way of that.

so my questions are: will removing them negatively affect the headset in any way? (i know i need a T6 Torx driver) but how difficult is it to do? can i reattach them if i do change my mind? and how difficult would it be to go back if i wanted to?