Scrolling Issue

I have the same issue and ive tried to factory reset it and its still not working

Definitely sounds like you have stick drift on the controller. If under warranty contact
Xbox Support directly for assistance else you will need to replace the controller.

Do you have problems with the console? I suggest you call or contact the service center. Advice have you tried to put the console back in the factory state?

Hey Brendan thanks for taking the time to bring this issue to us!

We apologize for the inconvenience but rest assured we are here to help. We suggest performing a soft reset through the troubleshooting screen. Also has another controller been attempted?

If you're unable to get to the dashboard at all to do the factory reset (with the controller plugged in) you need to access the Troubleshoot screen by using these steps :

1. Unplug the network cable if you're using a wired network connection.
2. Power off your console, and then unplug the power cord to ensure that the console is completely powered off.
   
3. Wait 30 seconds, and then plug the power cord back in.
4. Press and hold the BIND button (located on the left side of the console) and the
   EJECT button (located on the front of the console), and then press the
   Xbox button on the console.
   
5. Continue holding the BIND and
   EJECT buttons for 10-15 seconds.
   
6. Listen for two “power-up” tones a couple of seconds apart. You can release the
   BIND and
   EJECT buttons after the second power-up tone.

NOTE: This will kick off all accounts signed into the console so be sure to know the account details.

From there you can reset your console, give it a shot and let us know how it goes!

If you have done a factory reset and different controller.

You're going to need to send it in to be serviced. You can do so here.
Xbox Device if its still under warranty.