The "options" didn't work for me. The suggestion got me looking and I found that I had to do this:

dataframe.ExcelWriter(export_location, engine = 'xlswriter', engine_kwargs = {"options": {"strings_to_formulas": False, "strings_to_urls": False}}) as writer