Siri Comes on without me saying "Hey Siri" on Mac

I am running Ventura (Mac OS 13.0) on a 2021 14 Inch MacBook Pro with the M1 Pro Chip. Since upgrading to Ventura, Siri will just start responding to requests it thinks I've made. I am not saying "Hey Siri" or really anything remotely like that phrase that may confuse it. And it will start doing random things, like looking up some completely random fact through Safari, or playing some song on Apple Music. This happens a lot when I'm on a phone call through Zoom.

I have gone to Settings and turned off Ask Siri. I'd rather not do that, because there may be times I want to use Siri, but with it just going off, especially when I'm on a Zoom phone call, I have to. Of course, I want to know that with Ask Siri off, I am not going to get Siri just responding when there is no request.

But also, other than turning off Ask Siri, any other suggestions on how to stop this would be appreciated.

Thanks.