Xbox app party glitches

Due to my headset breaking I’ve resorted to using the xbox app. I’ll join a party on my phone and after a couple of minutes someone’s audio will cut out, the only quick-fix I have is unplugging and replugging my headphones, though sometimes the problem will
still occur with no headphones plugged in at all.

I have reinstalled the Xbox app numerous times with no avail, this only started occuring after the most recent update.

Is there any fix for this or will I have to wait till they can put out another update?

:)