In the end, I put this line of code unset DOCKER_HOST in my bashrc.

But I do not think it's the right solution, thus I'm not going to accept this answer as the correct one.