How can I see how many songs I have in my Apple Music library?

On an iPad, see Apple Music app > Songs

iPhone doesn’t seem to show this info, tho’.

Go to 'Settings' then 'about' and scroll down to songs... viola, there is the number

Yes it does, in settings!