My Series X is not responding to Controller

Hi there.

I have jumped on to play my Series X today and after about 2mins the I lose control of the xbox and it keeps sending the cursor to the top of the menu, I hard reset - took the plug out, updated the controller, changed controllers and it still happened. It kind of feels like I'm fighting another controller for control of the console?

:)