I found (thanks to Adrian comment) that adding this at the root view of the app fixes the problem:

RootView()
    // `.accent` because my color is named `AccentColor` in the asset catalog
    // Do not use `.accentColor(.accentColor)`, it will not work
    .accentColor(.accent)

But it's really weird that AdMob changes the accent color set by Xcode automatically.