Screen sharing fails after a period of time

I am using an M1 Mini and use screen sharing from my laptop to connect to it and manage it. Everything has worked for years and suddenly it appears to drop the connection after a period of time and I can no longer start a screen sharing (or VNC) connection. I am forced to use terminal on my local device and restart the mini [sudo shutdown -r now]. After it restarts all is well.

Any ideas? It seemed to start happening on OS 12.5 and it persists on 12.6. Looked in the log files and I cannot find any hints. Any suggestions?

Paul