Homepod mini disconnecting from internet when connected to Apple TV

Ok I have 2 homepod minis connected as stereo pair connected to the latest Apple TV4K ethernet. 1 patch before the latest one, i believe 15.2? it was working perfectly. After the latest update with the temperature monitor. The homepod loses connection to the internet whenever it is used as speaker. I can see it from my router page both literally disconnect itself from the internet and stays disconnected even when the Apple TV is off.

I tried a factory reset on both of em and they work again. But after a few hours they disconnected again. Then I tried going to the appleTV setting and switch the default speaker to my TV again. And behold the homepods connect to the internet normally.

I think theres some bugs with the latest OS hope you can fix it