I am not sure if I understood the question correctly. Here is what I thought: You have two groups of images (group A and group B). Each group contains 100 images. You want to measure the similarity between group A and group B. Maybe one thing you can look into is the Wasserstein distance, which quantifies the dis-similarity between two distributions.