You can share the pipeline service connection for GitHub created by the GitHub Azure Pipeline app between multiple projects within the same azure organization. Go to Project Settings -> Pipelines Service connections -> select the GitHub service connection -> ON top right, edit Security -> Project permissions -> Add projects.

However, as said, it's only within the same org.