I found a manual but very simple solution

cd ~/.android/avd
rm -f DEVICE_NAME.ini
rm -rf DEVICE_NAME.avd

For windows, use the equivalent commands. I usually use git bash for things like this on Windows.