Mac Mini 2024 Keeps Waking Connected TV

I've just hooked up my 2024 Mac Mini to my TV using a HDMI cable. Exactly the same way that I had my 2018 Mac mini connected previously.

However, the new mini randomly waked the TV screen from standby or switches to its HDMI input while we're watching TV.

This morning I woke up and the TV had turned on over night and the Sequoia screensaver was on.

I can turn the HDMI functionality off on the TV but then that stops us being able to use that functionality on ANY connected devices.

Is there a setting I'm missing in Sequoia to stop this from happening?

Thanks.