As this is a client side issue its solution lies in the client side.
I just needed to configure cookies in client side:
builder.Services
.AddAuthentication(...)
.AddCookie(CookieAuthenticationDefaults.AuthenticationScheme, o =>
{
o.Cookie.MaxAge = TimeSpan.FromDays(180);
})
.AddOpenIdConnect(...);