Controller is not syncing with XSX after wake from a long sleep

It happened to me after waking up from sleeping then quitting the game

For what it's worth, PS4 will wake from sleep no problem on the same wifi. It's funny. After getting wifi to work again on xb1, upon a power off in instant on mode, it wont wake from the windows 10 app, and wont be connected to wifi again.. ugh.

the router an stuff are fine my dads the local cabal guy an we just got the new top of the line stuff not to long ago and when i say wake up i mean after playing xbox i shut it off i go to sleep then i wake up turn my xbox on an it isnt connected so i have
to turn it off then back on again

My elite controller is up to date and thats the one I have been using. If i plug my controller in by usb the system will turn on just like if i was to touch the xbox one logo on the system. really anoying this is. What would cause my system to go into such
a deep sleep in instant on that my controller wont wake the system up. If i turn the system on by hand in the morning i can use the controller all day but when i dont use the console four like 12 hours then the controller wont wake the system up. On energy
saving mode the controller can wake the system up every time but boot times are to long. I like instant on. Just want the controller to always work to turn it on.

Did a full factory reset and reinstalled all the games from disc. The problem occurs as soon as YouTube app is reinstalled and opened. This may only be impacting older model XB One units. May just be that the OS is either not putting the app to sleep properly
or not waking up properly after sleep. Does not happen with YouTube removed from the console.