Code is working as expected, Http client timeouts actually working with Polly properly. After lot of research found out that Kong gateway API, has a default timeout of 60, got that increased similar to http timeout and everything working as expected.

We will also add logs into Polly policy so that any future errors gets highlighted.