GitHub user Osyotr's suggestion worked -- adding the following to CMakeLists.txt:

target_compile_definitions(${target_name} PUBLIC "$<$<CONFIG:Debug>:BOOST_DEBUG_PYTHON>")
target_compile_definitions(${target_name} PUBLIC "$<$<CONFIG:Debug>:Py_DEBUG>")

Thanks, Osyotr!