Apple Music Lossless streams stop playing after 10 to 20 seconds

My Apple Music app will only play the first 10 to 20 seconds of a track when streaming Lossless. This seems to only happen when I'm streaming iTunes Match tracks and not Apple Music tracks. It's clear that the track stops loading after the first 10 to 20 seconds. I'm using a brand new M2 Pro Mac Mini and my internet connection is over ethernet and I have a download speed is 531 Mbps. When I switch streaming to High Quality (AAC 256 kbps) the tracks play all the way through but the sound difference is noticeable. I don't understand why my internet speed can't handle Lossless audio when I can stream 4K video with Dolby Atmos sound just fine. Does anyone have a recommendation on how I can fix this problem?