The culprit is Mozilla Firefox web browser.

User downloads and launches distributive using this web browser -> installer installs and launch our app -> app is loaded with C++ runtime installed in system instead of the one we provide.

This is not reproducible with other web browsers.