Only B,A, Xbox button, and the ones 3 below it are working an remote play

Do I need to have Instant-On enabled?

Yes, "To set up remote play in the Xbox app for mobile devices, you’ll need to set up a few things on your console first:

1. Press the Xbox button  on your controller to open the guide.
   
2. Go to Profile & system > Settings > Devices & connections > Remote features.
   
3. Check the box to enable remote features.
   
4. Under Power mode, select Instant-on.
   

You’ll also need to set up a few things in the Xbox app. Select Learn more below to find out how.

Learn more

thank you, also when using remote play the Xbox button on the controller dosent work, but it still works when I’m not using remote play

I have the new Harmony Ultimate and the same thing happens with me. The soft buttons (i.e. A, B, X, Y) also don't work for me. Due to the Xbox One only having a 9 foot long cable for the Kinect 2, I don't have my Xbox One in the media closet. I set the
remote to manually only use the remote instead of the blasters and that fixed the soft buttons, but the power on and power off still do not work.

Hello,

Thanks for the support message.

If the buttons are not working for your remote, please follow these steps below.

• Check for interference. Remove any objects that may block the infrared port on the remote or on the console. This includes metallic or metallic-painted faceplates on the console.
  
• If the infrared port on the faceplate is damaged, replace the faceplate.
• Put new batteries in the remote control to determine whether the behavior is caused by weak batteries. Remove the batteries from the remote control, press each button two times, and then replace the batteries.
  

More information on your issue:

Xbox 360 Universal Media Remote

How to troubleshoot your Xbox 360 Universal Media Remote

Should you have any other concerns, feel free to post back.

Cheers!

Hello Jesscollie,

the process needed to set up the remote can be found on the two pages below, but I would sugges scanning for the TV code with the following process

Scan for a TV code

You can send a sequence of codes to from your remote to your TV to find the right code for your TV, if you do not know it.

1. Turn on your TV and point the media remote toward it.
2. Press and hold the Mute and 5 buttons simultaneously for two seconds to enter TV programming mode.
   
3. Press the Channel Up button repeatedly to send one code per button press from your media remote to your TV. By pressing
   Channel Up, you advance the code each time.
4. When the correct code is sent from the media remote to your TV, your TV will turn off. Press the
   Select button to confirm your code.

If your TV turns off but you then accidently continue to press Channel Up to continue past the correct code, press
Channel Down to go back to the correct code. Your TV will turn on again when you go back to the correct code. Press the
Select button to confirm your code.



support.xbox.com/.../media-remote - this one also contains is list of all the codes for TVs

support.xbox.com/.../universal-media-remote



Please come back and let us know if this worked



thanks

Hello jameson knott,



Greetings!



Thank you for posting in Microsoft Community.



Based on the description, you are having issue with the controllers used during remote play where some of the buttons do not function correctly. Let us check and see on what we can do to help resolve your concern in a timely manner.

We would like to ask few questions to help us isolate the issue further.

1. Does joysticks and triggers buttons work when using remote on other devices?

2. What type of controllers are you using? Can you provide make and model?

3. Have you tried connecting the connecting to other devices like through Windows Pc or Xbox console and no issues with the button function

It is possible that the type of controller does not fully support some of the functions of the button during remote play and cloud gaming. When playing Xbox games with cloud gaming and remote play, we recommend using an Xbox Wireless Controller connected via Bluetooth or USB cable. Many other types of wired and Bluetooth controllers can also work for cloud gaming. Controllers that are identified as Official Xbox and Designed for Xbox are optimized for the best cloud gaming experienceand remote play. Verified controllers will work for remote play and cloud gaming but may be less optimal.



We look forward to your response. Kindly let us know, if there is any misunderstanding or clarifications of our description by sending us a reply.



Sincerely,