Problem solved. I accidentally overwrote the exception handler with
app.UseDeveloperExceptionPage();
I need to make sure that
app.UseExceptionHandler();
is called AFTER