Looks like this is explicitly not supported by PyPI: https://docs.pypi.org/trusted-publishers/troubleshooting/
Reusable workflows cannot currently be used as the workflow in a Trusted Publisher. This is a practical limitation, and is being tracked in warehouse#11096.
Time to refactor our GitHub actions I guess.