You need to configure the WSO2 default model provider for this case.

Please follow the guide in https://bi.docs.wso2.com/integration-guides/ai/direct-llm-call/direct-llm-invocation-with-ballerina-model-providers/#step-5-configure-default-wso2-model-provider