I have the same use-case and there seems to be a solution posted in the LlamaIndex forums. https://github.com/run-llama/llama_index/discussions/8432 Pattern is:
I am in the process of trying this out but this is the suggested solution.