I got it working by specifying sslmode=require in the connection string.

var pw = encodeURIComponent("##pw##")
const pool = new Pool({connectionString: `postgresql://username:${pw}@server.postgres.database.azure.com:5432/dbname?sslmode=require`})