I never found the answer to my question, however updating to Ubuntu 24.04 (without resetting my computer) solved the problem. I have no idea why that worked...

Maybe updating the system reset some path... After that, I had to reinstall some R packages that were broken too, hence my believe in some paths that got reset