Songs showing in Library but aren't in library because I can't remove it

I recently switched over to AM from Spotify and had to learn the hard way that songs deleted from your library get removed from any playlists they're in. So I had to delete what I had transferred so far, turn off the setting that automatically adds songs to library when adding to playlists, and retransfer/transfer the rest of my playlists with the goal of keeping my library empty. I have a ton of music so this took weeks and I just finished. But when I go into my library on my laptop, it shows a bunch of random songs that are in various playlists I just transferred into AM. I specifically didn't want this because I don't want to remove songs from playlists whenever I remove from library. But then when I go to remove from library, it only gives me the option to add to library, even though they are appearing in my library (under songs, albums, and artists). This is only happening on my laptop, not on my phone but I just did it so I don't know if it just hasn't synced yet. How do I remove these songs... AND ideally not remove them from the playlists they're in also?? Are they even in my library???