Eventually I opened a support case at Azure and got the response that MI is not supported for BULK INSERT into temporary tables on Azure SQL.

I found a workaround, however. If you can live with the databases accessed by an account with SA permissions, you can add your MI into the role which is made SQL Admin in the server settings. Not a recommended approach, though.