I found an answer buried in the kreuzwerker repository:
https://github.com/kreuzwerker/terraform-provider-docker/issues/534
The issue is that having containerd enabled in Docker breaks the build, at least on macOS. Disabling it fixed the issue for me.