I found the error.
Turns out there was an issue with the conan_provider.cmake. This only installed Debug and Release.
The compile_commands.json however also contained info for MinSizeRel and RelWithDbgInfo. Since conan did not fill those configs, the include paths where missing here in my compile_commands.json.
After adding the other configs to the conan provider my compile_commands was fixed and clang tidy does seam to work :)