As of .NET 8, I was able to make this work:
app.UseExceptionHandler(subApp => subApp.UseDeveloperExceptionPage);
If all IExceptionHandler return false , then the subApp logic is used instead.
IExceptionHandler
false
subApp