Can't change audio output without restarting the Apple Music App in Windows 11.

I use Apple Music and not iTunes on my Windows laptop but whenever I plug in a new audio device or connect via Bluetooth Apple Music will not change outputs without restarting the app.

I checked that the audio output for Windows is on the correct device and every other app will play through the correct device except for Apple Music.

Ex. I'm listening to music and connect headphones to my laptop. If I play a Youtube video the audio will play in the headphones, but the Apple Music will still play on speakers.