I have the same problem and tried things for multiple days now. I don't think there is a resonable solution here.
I will switch to using mp4 for local video playback on iOS.