In my case when I saved the alias name I saved it with quotes, but they were saved in the alias as some different format than double quotes normally typed. I had to copy the alias with the quotes directly then surround that value with single quotes to get keystore to recognize it.
sudo keytool -delete -alias '“aliasname”' -keystore "store"
" - regular double quote
“ - alias double quote