Why won't xbox ultimate share with the family?

For the most part Xbox Ultimate works fine I can download game pass games without being on the main account that has ultimate however each time on the right it will also say "get game pass" and then there are times where it just won't let me download at all(i.e. Ghostwire: Tokyo, Hi-Fi RUSH, and A Plague Tale:Requiem just to name a few.) I was wondering if this is normal for certain games or if this is a problem and what I need to do to fix it.

:)