Thanks for your comments and answers. I analyzed how the code behaves in previous version vs. V3
I noticed that upserting 100 documents in BulkExecutor took over 2 seconds and consumed over 2 000 RU.
In V3 it took 7 seconds, consumed almost 2 000 RU, while some of the documents failed.
So I decided to upscale before my code to a significantly larger throughput and downscale after the operation finishes. This gave me the desired results.
I did some reading up and there are more ways to handle it, such as:
But due to my setup, I decided to stick with manually increasing the throughput for the time of my operation.