Apparently I had changed the default template. Using this fixed it:
plotly.io.templates.default = "plotly"