I recommend using Homebrew. For example: brew install llama.cpp I was able to install it easily. Please try it!
brew install llama.cpp