I have found the answer by looking at the code!
The PhoneNumberInput component has a countries option, which can be used to restrict the list of countries.
For instance:
<PhoneInput
placeholder="Phone #"
value={phone}
countries={["US","CA","IE","GB"]}
defaultCountry="US"
onChange={keyChangeHandler}/>