There is actually a way to achieve this. In cases such that you are packaging multiple executable in a single package, this option will be helpful. I've verified this with pyinstaller==6.15.0

exe = EXE(....,
          ....,
          contents_directory='_new_internal'
      )