Should have read the doc as @jonrsharpe suggested. I had to set the deploy to branch, and select the gh-pages branch. Works like a charm now!