Xbox Series X controller freeze when the headset is plugged in

So the controller works fine the cable I mean when plugged into my laptop so I know the cable works. Now on the series x all 3 ports don’t work with this cable but work fine with my headset plug in.

The headset should work on an Xbox One controller and Xbox Series S/X controllers.

Turn off the controller by holding the Xbox button on the controller until the controller turns off and unplug the headset.

On your console press and hold the Xbox console button until the console turns off, remove the power cord from the console, and wait 1 minute.

Plug the power cord into your console again, turn on the console with your controller, and when you see your console's dashboard connect the headset to the controller and see if that solves the problem.

yes on xbox series x. with all controllers. wired headset.

Thanks for the suggestion but unfortunately the firmware on my controller is updated. As I mentioned this didn't even start happening until after that I updated the controller.

The issue still happens every time I plug in the headset adapter. I'm still narrowing down the exact cause, but it seems if I join a party or start a game prior to attaching the adapter the controller will freeze when I do attach it and then the system has
to be hard restarted for me to be able to use the controller again. Sometimes it will freeze if I unplug the headset from the adapter and plug it back in. This happens with multiple headsets (Astro A40s and an Xbox 360 headset).

I think it's an issue with the new controllers for some reason. My Series X controller will freeze once a week or so (always when I'm in the middle of a race unsurprisingly!!)....I'll be driving and my car will suddenly just veer off the road and then be constantly accelerating. Only resets when I remove the battery from it. This is on the Series X so may not be the same of course.

Having said that, it has only happened with the Plug and Play Battery...never happened with normal rechargeables.