PC randomly stutters with no apparent reason

Hey, I am not sure if this belongs in Hardware or Software since I was unable to identify the real culprit of the issue so far.

Issue: My PC randomly stutters with mouse skipping across the screen, the displayed media stuttering and audio corrupting as in getting a robotic sound. When the issue gets more severe it seems to disconnect and then reconnect my mouse/USB device. The issue does not rely on full load or idle, it happens in both cases and at anything in between. It seems to me that when the issue occurs it gets worse over time and it won't disappear. At least until I restart my PC, then it sometimes won't happen for a while. Tried GPU and CPU benchmarks, idling over night, normal use with YT-Videos and gaming - all scenarios lead to the issue occurring at some point.

PC Specs: - Ryzen 7 7800x3d - 2070 Super - 32GB DDR5 RAM from TridentZ - Corsair HX1000i PSU - Gigabyte B650E Aorus Elite X AX ICE

Mainboard, RAM, CPU are 1 year old. PSU is boight 1 week ago for test purposes. Rest is 5y old.

Troubleshoots done so far: - I reinstalled windows 11 completely on a new SSD - I installed a new PSU with 1000w compared to my 850w psu before - I Uninstalled all my GPU drivers and manually reinstalled them - I updated all drivers and windows updates - I updated my BIOS - I ran the windows internal RAM test - I undervolted/cut down the Mhz on my GPU by about 10% - my temps are completely normal for all devices - ran LatencyMon with the only outlier being nvlddmkm.sys with having a ms of over 1ms

All of these steps without any difference to the issue. And none of the test showed any issues or failures.

Is anyone able to identify the problem perhaps or help me find what's causing it? Id really appreciate your help, I've been at this for a week now.