PS5 controller only works when I point it to my PC case

New PS5 controller, connected via Bluetooth, but it often lose signal (my guy in-game will spin in circles and none of the bottoms register) and only works well if I point it down to my PC. I be playing elden ring and all the sudden my inputs don't register and I die.