I fixed the issue by using the StaticDatePicker MUI instead of DesktopDatePicker MUI. Not really a fix, more a workaround.