I ended up figuring out the root issue. The newer versions of OpenXML seem to be incompatible with Power Tools. The simple way to fix it is to only bring in Power Tools and let it grab the version of OpenXML it prefers rather than installing OpenXML first.

This was using NuGet in Visual Studio.