You can change it directly on the registrar, Azure uses GoDaddy for it.

Azure used to have a button on App Service Domain but not anymore, but you can still login here:
https://dcc.secureserver.net/domains

Do a password recovery for your username and password using your azure email.
It will let you change your nameservers and even transfer your domain.