For now I have reintroduced an older version where the entire solution is .NET6 based and that seems to solve the problem for now.