I cleared my user-secrets for the AppHost project and that seems to have done the trick.

dotnet user-secrets clear

Re-running Aspire after this correctly redeployed missing resources and didn't re-deploy resources that hadn't been deleted.