I've figured it out,

I used the python code provided by aws to create index patterns.

https://repost.aws/knowledge-center/opensearch-index-pattern

CURL command provided in the doc did not work as it gave me 404 not found error.

Please note that if you are creating index patterns in custom domain, please pass the headers as securitytenant instead of security_tenant mentioned in doc.