I have the same exact use case as you where the service running within the vertex ai pipeline component container is not authenticating using the service account used to .submit the pipeline. How did you manage to resolve this?
Reasons:
RegEx Blacklisted phrase (3): did you manage to resolve this