dotnet user-secrets remove "Kestrel:Certificates:Development:Password"
After much solving, this solved the issue.