For css:
button.gm-ui-hover-effect { visibility: hidden;}

Or Props:

<InfoWindow
          position={school.locationPoint}
          options={{ disableAutoPan: true, headerDisabled: true }}
        >