Xbox One Series X controller doesn't work with Forza Horizon 4

This afternoon my Xbox One controller stopped working with Forza Horizon 4. The strangest thing is that it is working with other games and in system UI.
There are no issues with any other game, only with FH4

Steps to reproduce:
1. Turn On the console using the controller (Xbox One Series X)
2. Sign in to the account
3. Launch any game
Note: Controller is working perfectly, no issues so far.

4. Launch FH4
5. Skip the intro (controller is working)
6. Press the "A" button to continue the game

Note: I'm stuck on the screen where I have to press the "A" button in order to start the game. After pressing the "X" button nothing happens as well.

5. Press the Xbox button on the controller to display the side panel (controller is working in system UI)
6. Hide the side panel by pressing the Xbox button again

Actual result: "Controller disconnected" pop-up is displaying. Controller is working perfectly in all other games and system UI. The issue persist only in Forza Horizon 4

Expected result: Obviously, controller should work in all games

Game version: 2.465.297.0
The latest system updates are installed. The controller firmware is up to date. No newer FH4 game updates are available at the time of writing this post.

:)