Opening just Powershell did not work. I opened the "Developer Powershell For VS" and then the az and azd tools were available.