ok after hours of searching and messing around with my packages I found removing this package
DarkLoop.Azure.Functions.Authorization.InProcess
and replacing with
DarkLoop.Azure.Functions.Authorization.Isolated
worked, except now I have an empty swagger UI