Remove Apple Music downloads after unsubscribing

After I canceled my Apple Music subscription, I realized that all the downloaded songs were still saved on my phone. I couldn’t find any way to remove them since the I didn’t buy the songs, only downloaded them when I had the subscription. Is there any way of deleting all of them now that I no longer use Apple Music? It takes up a lot of storage.