The error is caused by find_package looking into SDL directory in my project root directory.
The error message reviles the solution by itself, I had to set CMAKE_PREFIX_PATH to point find_package to the correct SDL build
set(CMAKE_PREFIX_PATH "${CMAKE_BINARY_DIR}/sdl" ${CMAKE_PREFIX_PATH})