I needed one more step than Imad to make it work:
sudo chmod 600 path-to-keyfile
This is because, according to the mongo doc, "On UNIX systems, the keyfile must not have group or world permissions."