I had the same issue on my windows machine. You need to close VS Code entirely and then delete it manually from the folder. This should work. Thanks!