i had simmiliar error, what helped me, was using python 3.10 instead of 3.12. For some reason, spark doesn't work in 3.12, so i created a virtual environment with 3.10