I wanted to share the solution I found for improving performance when submitting documents to Azure AI Search.
The documentation wasn't very clear on this, but It was suggested that batching data before sending significantly improves performance. Using indexers wasn't suitable for my needs since they sync at a minimum of once every 5 minutes.
I conducted a test using a free-tier Azure AI Search instance. I sent 10, 50, 100, and eventually 200 concurrent POST calls. I even scaled up to sending 200 concurrent calls 100 times. Despite the free-tier limitations, the overall response time remained stable, and I didn't encounter any 503 errors.
In conclusion, even with the free tier, the service's compute power and throughput are robust enough to handle 500-1000 push requests effectively. I hope this helps anyone facing similar challenges!