First of all, if you use Elasticsearch in single mode, comment cluster.name: my-application.

Second you are using xpack.security.enabled: true So you should set xpack.security.http.ssl: enabled: false to true.

Use this link to create SSL Certs:

Configuring SSL/TLS to secure Elasticsearch.

You need to have enrollment tokens. Use this link to create enrollment:

Start Elasticsearch and generate an enrollment

You set server.port: 5601 but you call kibana http://10.xx.xx.xx/app/home without a port? If you use nginx as reverse proxy, first try to access Kibana without reverse proxy.