Safari Download Location Constantly Changes to Downloads Folder

I always use desktop for downloads and it has been one of the essential preferences in my Safari set up. Recently Safari swaps downloading to the downloads folder even it is set to desktop in preferences. It changes the preference option itself from desktop to downloads folder. Once it is set to desktop, it downloads to desktop normally. But when safari is quitted and restarted (even the option shows "desktop") the first download is done to downloads folder and the option in the preferences pane is automatically changed to "downloads folder" and all the next starts of safari keep on downloads folder.

This is an old bug but still happening with Ventura13.7.6 (22H625)

Is there no fix?