Homepod and iPhone won't respond

Both my Homepod mini and iPhone 15 pro are on the latest versions. When I'm at my desk with the two devices sitting about a foot apart neither responds when I say "Siri" or "Hey Siri". They both light up that they heard me but then they just stop. They respond normally when my iPhone is not on my desk though. I tried powering both off and on again but I still get the same results.

From what I have found it seems like the way it is supposed to work is which ever device hears me the best takes over but it seems like the devices are just assuming the other heard me better. Thoughts?