Switching between media apps on phone using lock screen.

The lockscreen option on the iPhones Apple TV interface allows you to switch between media apps on your phone while casting to Apple TV. I’m experiencing consistency problems, sometimes the cast still switches to the other app that I switched to on my phone. It happens mostly when casting YouTube and opening TikTok or Audible on my phone. Does anyone know the solution for this?