Remote play problem on xbox series x

Hi,

So I have this problem with my xbox series x.

I use remote play (from ipad on wifi, PC wired, any client) and sometimes it stutters every 10 seconds for a second or 2.

But sometimes it doesn’t! After a week of troubleshooting trying to find a pattern, I finally found one.

If I remote play while the tv where the xbox is connected is OFF, it stutters.

If I turn the tv ON, smooth as butter.

Also, instead of turning ON the TV, I can disconnect the HDMI cable from the xbox and it works.

Any way to fix this?

Thanks

:)