To anyone finding this answer in 2025 and beyond, the Docker post install documentation also recommends creating the docker group and adding your user to it.
docker