Mockito now supports verification after delay: https://javadoc.io/doc/org.mockito/mockito-core/latest/org/mockito/verification/VerificationAfterDelay.html

verify(mock, after(500).never()).bar();