I've read through all of the Preferences in Acrobat and figured the solution myself.
Preferences > Security (Enhanced) > Uncheck Enable Protected Mode at startup
Done! No more "file might be in use" error.