I had this problem on a M4 Mac and found that lowering the MTUs on my network connection from 1500 to 1280 did the trick, regardless of IPv6 being enabled. I hope I save someone else some trouble figuring this out! It took me hours.