Turns out, it was because I was running out of memory and docker was just killing the container, I tried the same setup with 2 replica and then adding a third one, that works as expected.