I was having the exact same error with some fairly simple dataset. Apparently the CRAN version of prophet is pretty outdated. I installed the latest version with:

remotes::install_github('facebook/prophet@*release', subdir = 'R')

After re-running my code, the error simply went away.