If your project is timezone naive, you need to set the following in your settings.py:

DJANGO_CELERY_BEAT_TZ_AWARE = False

This resolved the issue for me.

Additionally, you may need to manually set NULL to the last_run_at field in the PeriodicTask model, or you can wait 24 hours for the UTC timezone to pass.