Websites don't open sometimes in Safari, gets stuck at "redirects"

I noticed that occasionally, some websites take very long to open in Safari, sometimes even failing with "Server dropped connection unexpectedly", especially while using a VPN service that tunnels all network requests at system level. From the web inspector, I see that the webpage request gets stuck in the "Redirects" stage for a while. When I try to load the page using another browser or cURL, it fetches instantly without issues.

(However, Firefox returns with a "network protocol violation" error at rare occasions)

I wonder if some feature within Safari that's causing the site to not load correctly. I disabled "Hide IP Address from trackers" and fraudulent site warnings (which uses Tencent since I'm in China mainland). I think that Safari might be making other network requests before loading the actual page, which sometimes fail. It would be appreciated if there's any solution to this.