I mistakenly ended up downloading the aarch64 binaries. Github releases didn't show them all and I had to click the "show more button" below the releases.
After redownloading the correct binaries everything started working as expected.