Stick drift only when using xbox apps or software

That's called stick drift and has nothing to do with this firmware issue. Your controller is broken, you can have Microsoft fix it for a fee or replace it. But no software update will fix stick drift.

Delete the hardware? Do you mean software? Stick drift is a hardware malfunction and can’t be corrected with software upgrades.

That is strange. I've only ever had stick drift on my old 360 controllers. I don't know if the standard Xbox one controllers have it, but the Xbox Elite controller sticks can be adjusted to have dead zones to avoid drift. Check in the Xbox Accessories
app if you can adjust it for normal controllers.

That is strange. I've only ever had stick drift on my old 360 controllers. I don't know if the standard Xbox one controllers have it, but the Xbox Elite controller sticks can be adjusted to have dead zones to avoid drift. Check in the Xbox Accessories
app if you can adjust it for normal controllers.

Have my elite controller set up and still drifts. Can't do standard controller. Did notice they drift worse on any COD.

Performed some more checks using the controller app and although it was aiming right which is why I thought it was the right stick it actually turns out the left stick has the issue drifting right.

It's only slight but seems to stick like that 1 in every 3 moves of the stick. The app at least shows me what was happening.