I had the same issue. It turns out docker-mailserver was silently failing on my password due to the characters being utilized.

To debug, I'd suggest using a simple plaintext password and then iterate on that.