The conda's boost library in windows doesn't include the debug versions. See here.

I was attempting to build with CMAKE_BUILD_TYPE=Debug which then caused a mix of debug and non-debug libraries. I wasn't aware that this was a problem as it appears to be a minor issue in Linux. But in windows it appears to be a very big issue.

Thank you Botje for the information.