The rights of the key files, or ssh-add are only the most common solutions. None of them worked, solved by:
gpg-connect-agent updatestartuptty /bye