Audio Output Does Not Switch Automatically When Changing Devices in Windows

On Windows, if I switch the audio output device while music is playing, the sound continues to come from the previous device.

For example, if I’m listening through my laptop speakers and then connect headphones, the music keeps playing through the speakers instead of the headphones. I have to manually change the audio output or restart the application for the sound to switch.