Use df.index.isin to filter index
df.index.isin
sub_df = df.loc[df.index.isin([("A", "a1"), ("B", "b2")])]
https://pandas.pydata.org/docs/reference/api/pandas.Index.isin.html