Wireless intermittently stops working on Xbox One

I use the instant on power mode and every 3 or 4 times that I turn my Xbox One X on, it is unable to connect to my wireless network. I have to completely restart the Xbox in order to get wireless working again. I have tried deleting the saved info about
about my wireless network and reconnecting, I've tried changing between my 2.4 GHz and 5.0 GHz networks, and I've tried doing a console reset. Nothing has helped.

I am not currently enrolled in the Xbox Insider/Preview program. I used to be enrolled on an Xbox One S that I use to own, but removed that console from the program long ago.

Due to the layout of my home I have to use wireless to connect to my router. I do plan to run patch cable through my walls to have a wired connection in every room, but that is a ways off before I can do that.

If change the power mode from instant on to power saving, then the issue never happens. I suppose that is a temporary solution, but it doesn't really address the problem and I like instant on because i can pause a game, put the Xbox to sleep, and come back
later to resume my where I left off without having to wait for the game to load back up.

It could possibly be my router, but I don't think it is since I never have issues with other devices that use similar instant on power modes, and I have seen people reporting similar wifi connection problems with their Xboxes across various online forums.

Is there any way to fix this? Is there some defect with my console?

:)