In my case the fix was editing my C:\windows\system32\drivers\etc\hosts file, adding a entry for my SVN server.
SVN is doing some weird DNS stuff that does not work properly on windows in that it takes forever. This seems to bypass that.