After looking more into https://pyinstaller.org/en/stable/operating-mode.html

I am realizing that although we name the file .pyz it is, in fact, not a .pyz but an executable for Ubuntu