I had a similar situation in gitlab-ce. In my case I didn't have to login to gitlab-rails. From the UI as an admin, I just followed below steps
(Admin -> users -> <username> -> Identities - delete LDAP)
(3 dots at top right corner -> 'unblock user')