Remote play crashes display and networking on host pc if it's main display isn't turned on

Desktop Specs:

|GPU:|Geforce 3080ti 12GB|| |:-|:-|:-| |CPU:|Ryzen 9 5900X|| |Set Resolution:|3840x2160 120Hz||

So if I stream my pc games to my steam deck with my pc's main display powered on, games launch fine for the most part and I can play them fine.

But if I try to stream to my steam deck with my pc's diplay off, it'll say it's trying to launch the game but eventually say the connection timed out, and it causes my pc to no longer output any type of display or network connection; so if I turn on my pc's main display, it says there's no signal and I end up having to restart my pc to fix it.

I've tried steam stable & beta, enabled & disabled hardware encoding, enabled & disabled changing resolution on desktop to match client, enabled & disabled NVFBC capture, nothing fixes the problem.

I have a Yamaha receiver that my pc can detect as a second display, and even leaving that powered on and set to 1280x800 to act as a headless display emulator doesn't fix it. I don't know what else to try at this point.

I also tried with moonlight/sunshine and it was the same issue. Nothing wants to stream unless my pc's main display is turned on.

Edit: Just started a stream with the display turned on, game launched fine, then I turned off the display and a few moments later the stream froze and the "device disconnected" sound played on the host pc. When I turned the display back on, the screen was black so I alt+f4 the game and get returned back to the desktop, but the display's resolution was now stuck at 1280x800 and couldn't be changed through windows or Nvidia control panel. Nvidia control panel said I was no longer using a display being controlled my it, even after ending the stream on the steam deck. Had to restart host pc to fix.