You can do this by setting the variant on the drawer to persistent. It defaults to temporary.

<Drawer
  variant="persistent"
  open={open}
  onClose={onClose}
>

See the drawer example here:

https://mui.com/material-ui/react-drawer/#persistent-drawer