I came back the next day and the EasyNetQ_Default_Error_Queue is back and with errored messages.

My guess is something restarted and re-created that queue. I had restarted my local development a few times, but didn't see that happen.