Game bar party chat can't hear party

This is really starting to piss me off, I don't know what's going on.. my party chat was working absolutely fine and then all of a sudden people can't hear me in the party chat.

So if I join a party and I have the Xbox Game bar on the screen and can view the party people can hear me

However if I don't have xbox game bar on my screen they cannot hear me but I can still hear them? ( its like something isn't allowing it to run in the background )

That's not really my issue. My friends can hear me while I have Game Bar up on screen. As soon as I exit and play my game, my friends can't hear me. I just figured out that if I pin the party chat widget on game bar so it stays there when I exit game bar, my friends will still be able to hear me. For now that's what I'll stick with, but I'd like to be able to remove the party chat widget from my screen.

My headset only works in party chat. When I'm playing other games I can see that people are talking but I can't hear them and they can't hear me. It only works in party chat.

Well me and my group continue to have multiple party chat issues and party invite issues (can't hear people in party chat can't join etc)

Gotcha. I heard a rumor that they are working to fix party chat. Once I was in a party chat and I could hear my party AND hear the in-game chat for Battlefield 4. The rumor was they were going to revert it to the old party chat system by next month. I
forgot where I heard that so I can't source. Again, it was a rumor, so not sure its credibility.