HomePod Home Hubs 17.3

Since upgrading my HomePods to 17.3 and 17.4 my Phillip Hue smart devices in Home show ‘Updating’ or ‘No Response’ and takes 2-3 minutes to send the command. If I unplug the HomePods and let the AppleTV become the default Home Hub, everything works. I’ve factory reset all the HomePods, deleted and created my Home, and factory reset my router and wireless access point.

The only things that work are smart devices that I added through Matter.

Is anybody else experiencing anything similar?