Xbox One S freezing and slow to load anything

For the last few days, my Xbox one s is having some problems. Games are freezing and crashing. I mainly play Forza Horizon 4, Fifa 20, F1 2020, and GTA 5. Only Fifa 20 and F1 2020 I play through Xbox game pass ultimate the other two games I have bought(Digital Versions). For the last few days while playing Forza, the textures sometimes are not loading fast enough and the game is freezing there for a few moments. In Fifa, the game is also freezing but it is happening very frequently in Fifa and in GTA also the game is loading very slow and sometimes freezing. I tried doing a power cycle to clear the cache several times but after a few moments, everything is again getting slow. I also did reset my console ( Kept the games and files ) and after resetting I have noticed that the console is faster on the home page and also some apps are loading faster but while playing games the freezing issue keeps happening (mainly in FIFA 20 ). After the reset, games ran smoothly for some times but it then started happening again. I have also uninstalled FIFA 20 and F1 2020 and reinstalled, removed the account, and also cleared saved game files but the issue is still there. Probably the only thing left for me now to try is doing a full factory reset.

Another thing is that since the last firmware update, the Microsoft store keeps asking to update every time I open it. And when I was reinstalling Fifa, for a few times the installation stopped. It also happened in F1 2020 and the installation speed was very slow. Though the Xbox network status showed 57 Mbps download speed the download was not going over 2 Mbps.

The console is running all the games just fine sometimes, but then again after maybe 20 minutes, the freezing issue starts. The console is only 2 years old. Is there anything I can try to fix this issue?

:)