So after some research we've created our own microservice that basically runs a daily job that checks if all users still exist in Entra ID. This allowed us to stay away from external dependencies in the form of plugins.