Well, for what it's worth I got my code to work after make this change in my program.cs.

app.MapDefaultControllerRoute()
.RequireSystemWebAdapterSession();

I actually found it on their usage guide here.