I totally have same issiue and couldn't figured it out.
When i inspect my annotations and images, they totally match but when i run my model on validation or test set i get "0" AP and AR results.
Do u find a way to solve the issue?
Have a nice day,best regards.