As per this comment by a member of smac's dev team on a github issue on the subject, indeed there is a dependency that is easiest to compile with anaconda to provide cross-compatibility.

However, it's also worth noting that on linux there are prebuilt binaries for that dep, so conda is not actually required, and one can safely install using pip.