Party Chat not connecting to Twitch

I’ve recently started streaming directly from the Twitch app on my Xbox One S as well as my other friend. We always play in the same games using party chat, and for some reason, even if I’m the one to start the party and start streaming first, we can only hear the party chat through their stream, and not mine. The broadcasting notification only shows up once they start streaming, and not for me. We are all playing Xbox when this happens, so its nothing to do with cross-platform gaming. Also my voice goes through on their stream as well, so its nothing with my third-party access settings that i can think of. Has anyone dealt with this and been able to fix the problem? What can i do to fix the issue?

Thank you so much!

:)