I believe the size of each annotation varies each batch that is why it is complaining. Need to make a collate_fn.