Found a terrible workaround which is to clone README.md into the docs directory and move the figures directory into the docs directory.

If anyone with a more foolproof solution, while maintaining the rendering on Github and Readthedocs, please do.