Macbook M1 Max Ventura - HDMI audio output causes video skipping

As others have mentioned since 2021, when my M1 Max 16" Macbook (Ventura OS) I bought last year is plugged via HDMI into another display and I set the audio output to the speaker of that external display, I can't play videos anywhere (on QuickTime or Youtube) without the video constantly fast-forwarding and skipping forward in bursts. If I change the audio output back to my laptop speakers or aux headphones/speakers, the problem goes away instantly. This problem and unsatisfying solution have been observed when plugging via HDMI into my Samsung S95B TV and separately my Toptro projector. With the same exact behavior being observed in both.

Quitting coreaudiod in Activity Monitor did not help.

This is a bug in either the new Macbooks, or more specifically the M1/M1 Max chips and how they interact with HDMI devices. People have been complaining about this since at least 2021 - right after the first M1 Macs came out.

It's also possibly an OS issue, with the complaints also beginning around after Big Sur was released. The linked complaints (see the 1300+ people and 92+ people voting in the posts that they have the same problem) say the issue was observed in Monterrey, right after the update. We are now in the next OS after that, Ventura, and I'm still having this problem.

This is such a fundamental use case and an incredibly expensive laptop that I can't believe this still hasn't been resolved, two OSes and 2 years after it first was reported. I can't play my laptop on my television, projector, or any HDMI device without playing the sound from my laptop speakers or a separate aux speaker. That is crazy. Please fix this!