Controller not controlling Console streaming

all you are doing is streaming the image from the console, the console has to be used the same way as you would on the tv, a controller is only supported, i don't even think the games that support KnM even work over streaming and still have to use a controller.

When you test(on console) streaming ability, it DOES mention when it tests controller that some buttons may not work, and that a controller firmware update is on way to fix it

Ok, so I figured out that to get game audio/chat to work while streaming, we had to hook the controller up to the computer we are streaming to via USB. The headset stayed plugged into the controller. Yay! Game audio AND chat!

NEXT PROBLEM: there seems to be no way to control game volume/chat volume while streaming. We have mute chat at the top, but that is all. The computer volume controls do not affect the stream, and the volume controls on the controller adapter also seem to
do nothing.

How do you control game/chat volume while streaming?

Yup. Xbox One controllers are built a bit poorly.

If it's convenient to you i'd recommend using an Xbox 360 controller on a Windows 10 PC and stream your console to the PC using the Xbox app.

I am experience the same thing, tried with a controller wired, using Bluetooth, and using the Xbox Wireless adapter. My only fix is to start streaming and pair the controller directly to the console. Anyone figure this out?