I don’t think this is a compatibility issue. I tried recreating your issue and also added the Storage Admin role in the Document AI service account. It works when working with single files but I received the same error when working with a folder.
It somehow worked when I added the Storage Object User role in my user account ([email protected]) which you can change under the IAM section in the Google Cloud Console.