Controller works when no batteries in but when connected wirelessly gives up?

Basically, I'll turn on the Xbox, the controller will work for a few moments, then the console stays on, and the controller just dies this works on any of my controllers. If i remove the batteries of the controller and plug it in via a micro usb cable then
fully turn off the console then turn it back on, the controller will stay synced and working. If i put the batteries in and use wireless it will work for a few minutes then the controller stays on, fully synced but the controller doesn't work...

The batteries are 4 different sets, 2 cheap ones, 1 Duracell and 1 set of rechargeable ones that work perfectly on my pc.

All 3 normal batteries are brand new, but this is the same on both controllers.

The wireless keeps disconnecting me now as well.

If connected to the wireless i can use the app to control the Xbox perfectly

What do you mean the controller works with the "batteries out"?

If you are using rechargeable batteries, be aware that rechargeable batteries have less Volts than disposable batteries (which is not really a problem).

However, when rechargeable batteries get older, the Voltage drops more when they discharge with use, while disposable batteries hold the Voltage more constant, and only at the very end the voltage drops sharply before they die.

So it might be that in the short time you use the controller with rechargeable batteries, the controller hasn't got enough power to power it's wireless radio properly.

Please try the following:

Remove your batteries and connect a USB charging cable to the controller. Plug the controller into an USB power plug or powerbank (not an actual device like a PC or console), to power the controller.

Does the controller work wireless when connected to a powerbank or USB power plug?

You don't seem to have understood my problem.

It works fine with the cable but it doesn't work wirelessly. The controller disconnects when trying to connect it wirelessly with the play and charge kit battery. Wireless with AA batteries is fine, Wired with the charge kit is fine. Wireless
with the play and charge kit battery doesn't work.

I have the wireless adapter and I am trying to connect it wirelessly to my Xbox controller with the play and charge kit battery, that
is my problem.

Hello!

Are you connecting the controller wirelessly or with a USB cable? Does it do the same thing when connected via cable? Have you tried different batteries (or battery pack)?

If you can use your controller while connected through USB, that means that the wireless connection between your controller and your Xbox is working. Even when connected through USB, the communication between both devices is done wirelessly, with the controller only using power from the USB cable, not data. The controller is paired to your console when connected through USB, so the issue lies on your controller.

Check if the batteries inside of your controller are installed with the correct polarity. If they are, try to replace them with Alkaline batteries and check again.