We feel your pain.

We had the same issue with frameworks like Dialogflow. Maybe you can check out Nevron: https://github.com/axioma-ai-labs/nevron

It is a super light-weight scalable AI agent framework written in Python which has a dedicated memory module.

Memory docs: https://axioma-ai-labs.github.io/nevron/agent/memory/

Give it a try!