Is there really no option to stop people on my network from casting onto my Xbox?

Hello, first it's a pleasure to be able to help you today.

My name is welcome to the community.

Hello Jarrod, generally, the Youtube App has a way to delete the associated devices.

When entering the App, go to settings and then associated devices and remove the devices associated with the Youtube App.

Hello, I'm Felipe and I'm an independent Community Advisor, and I'll do my best to help you.

If the settings or preferences options that were previously described are not available on your XBOX One X console, there are other ways you can try to stop a device from casting to it on a wifi network.

One option is to change your wifi network settings to prevent the device from connecting to the network altogether. Another option is to disable casting on the device itself, if possible.

To change your wifi network settings, you can access your router's admin page and block the MAC address of the device you want to stop from casting. This will prevent the device from connecting to the wifi network and thus prevent it from casting to the XBOX One X console.

To disable casting on the device, you can check the settings or preferences options of the device itself. If there is an option to disable casting, you can select it and the device will no longer be able to cast to any device on the wifi network, including the XBOX One X console.

If neither of these options works, you may need to consult the user manual or contact customer support for the device or the XBOX One X console for further assistance.

cannot stop it really, if your tv is smart and connected to the network they can cast direct to the tv instead.

settings – devices and connections – remote features – disable PlayTo streaming

I haven't played my xbox for about a month at least and it was before the update the other day, before I could connect my phone to the xbox through the xbox app, then go to the samsung music app on my phone and there was an option to cast to xboxone, there
is no longer an option to cast to xbox one, I'll try and reinstall and power cycle my xbox tomorrow.

Thanks.