Try setting a default value of null or an empty string, depending on the typing you've set for the form field. In my case, setting null for the Material UI autocomplete worked:

<Controller controller={controller} name="field-name" defaultValue={null} render={...}/>