Mac Mini Keeps Freezing When I Use Sidecar

So I have a Mac Mini M4 and an iPad Air M2, neither of these devices are more than a month old however, there’s already issues with sidecar where my mac keeps freezing and I have to force shutdown every time for it to be useable again.

I tried a bunch of things online like turning off continuity, wired connections, signing in and out of Apple ID on both devices, setting screen timeout to never on the iPad and stronger WiFi connections but nothing worked. What did work momentarily was resetting the Mac completely but that only worked for a day.

Both devices are on the latest OS. Do y’all know how I can fix this as the apple representative wasn’t all that helpful?