My guess is that one file/folder is locked by another process. Which means that if you add the ignore_errors=True it will continue to remove the rest of the files and folders. It looks like you want to create a new empty folder to be sure to start from scratch.
The solution with ignoring errors might create hard to debug errors if a file is left somewhere when you expect it to be a empty folder.