I had the same problem - What was happening was the ssh keys were in two places causing incompatibility issues.

When I went and cleared out the two places and regenerated the key it all worked fine.