since InputAdornmentProps is now removed, I did it in following way:

slotProps={{
    inputAdornment: {
      position: 'start',
    },
  }}

this is also consistent with documentation here