Oddly enough, I realized that Artifact Registry was properly configured locally. I had to add gcloud auth configure-docker <region>-docker.pkg.dev to specify the region configuration