I finally found issue. I was literally 5 minutes before wiping my phone which would have bin a pain because of my banking apps and stuff. But I found a working solution!

Got to Developer Settings, and disable multi path networking.