Smart Playlist shows different results between Computer and Phone

Any simple Smart Playlist created on my computer shows completely different songs on my phone when set to random. That might be ok but the computer shows a mix of interesting tracks and the phone consistently just shows groups of multiple songs by the same artist. None of the songs are the same between the two devices. This happens on every smart playlist that's set to select by random.

Typical Smart Playlist parameters are:

MATCH ALL

Rating is greater than **

Last played not in the last x days

Limit to 10 items by Random

Live Updating