If you encounter a Permission denied (public key) issue when trying to git pull, regardless of the fact that you have set your keys correctly, you should just try to pull a specific remote:

$ git pull origin