Whoever stumbles over this might want to have a look at :user-invalid.

It behaves like :invalid, but is applied right after the user has interacted with the input.