How to stop Apple Music from playing automatically?

Apple Music starts up randomly without any input from me. It will suddenly start playing the first tune in the iTune library while I'm trying to something entirely unrelated, and Music is (supposedly) unopened. I also notice that Music seems to be permanently squatting in my Control Center, where it has no business being. How can I stop this annoying app?

[Re-Titled by Moderator]

Original Title: Stop Apple Music from playing