Why when I'm connected to my phone my joysticks won't work

I can do it thru my Xbox right

Yes, you can do this process on your Xbox as well.

Thanks for answering my questions, Jeremy.

Do you have access to a Windows PC?
If your answer is affirmative, please connect the controller via USB and open the Accessories app (you may need to download it if it's not installed).

When the controller is connected, you'll see the message Update Required if an update is mandatory. Install the update.

Reference link:
https://support.xbox.com/help/hardware-network/controller/update-xbox-wireless-controller

Once your controller is up-to-date, pair it with your Android tablet and try playing via cloud gaming again (first remove the controller from the known Bluetooth devices).

I have an Android tablet and I'm using Xbox one controller

I'm using cloud gaming and I've reset reconnected it's like if it's set for power button but I don't know how I would change that

Hello Jeremy. I'm Arturo, and I'll be glad to provide assistance with your inquiry today.

However, I find it appropriate to ask some questions:

-Is your phone an Android or iOS device?
-Are you trying to remote play, play via cloud gaming, or is this occurring with a game you downloaded from the Play Store/App Store?
-What is the controller you have—an Xbox Wireless controller, or one from a different brand?
-What potential solutions have you tried to solve this issue so far?
Please describe each one.

Thanks for your attention,

Arturo.