Okay, I've managed to fix this by first removing the package manually and then running fix broken install.
dpkg --remove --force-all python3-pyinstaller-hooks-contrib
apt --fix-broken install