Take a look at this Heroku buildpack, that lets you put your GitHub access token in an environment variable:

https://elements.heroku.com/buildpacks/heroku/heroku-buildpack-github-netrc

There are full docs on how to use it on that page.

Once you've got it setup Heroku should be able to retrieve your private repository over HTTPS.