Unable to use Xbox Cloud Gaming and Remote Play since sometimes in November/December

When I go to cloud gaming in the Xbox app it won't load the top row (recently played?) games. If I press play on one of the games in the other rows the app will go to a black screen instead of the usual loading space ship. From there nothing will happen, when I press quit game the app stays black no matter how many times I press quit game or wait. Only way to get out of the black screen is to quit the Xbox app. Same thing happens whenever I try to Remote play to my local Xbox Series X, which I bought sometimes in December.

It worked at first and then overnight it just didn't, no changes done to my PC.

I have tried:

Cloud gaming from browser = works

Cloud gaming and Remote play from a different PC on a different network = works

Cloud gaming and Remote play on a different xbox account on my PC = doesn't work

Cloud gaming and Remote play from a VM ware on my PC = works

Cloud gaming and Remote play from a fresh windows 10 and 11 installed on a USB stick = doesn't work

Cloud gaming and Remote play from a fresh windows 10 and 11 install on my PC = doesn't work

Cloud gaming and Remote play from a fresh windows 10 and 11 install on my PC and unplugging 3/4 screens and all USB devices except mouse and keyboard = doesn't work

Simply put the Xbox app hates my PC and won't let me play cloud/remote on it. This has been going on for atleast a month and no matter what I try it won't work.

Edit:

Cloud gaming and Remote play from my PC on a different network = doesn't works

Cloud gaming and Remote play from my PC using a local account instead of Microsoft account on a fresh windows 10 and 11 install = doesn't work

:)