What solved this for me, was linking libtag_c.a as well. So:
target_link_libraries(appMusikmixer
PRIVATE Qt6::Quick Qt6::Multimedia
${CMAKE_SOURCE_DIR}/taglib/libtag_c.a
${CMAKE_SOURCE_DIR}/taglib/libtag.a
)
libtag_c.a is created in <taglib build dir>\bindings\c\ and copied on cmake install.
(My guess is, the libtag.a is a dynamic library and the libtag_c.a is used to link to it statically. Similar to the Windows .lib using a .dll.)