Is there a way when I go into my Artist menu and view all the songs by that artist instead of the albums?

Yes. Do a search for the Artist and be sure to select “Your Library” under the search field. You will then see a list by albums, or scroll down to “Songs”.

Alternatively you can search “Apple Music” instead , if the songs are not in your library.