I have faced a similar issue building Qt 6.9.0 for Beaglebone Black, following the official tutorial for the RPI.
When configuring with CMake, add this flag -DFEATURE_neon=ON. All the Neon related problems should be disappear.
-DFEATURE_neon=ON