Firstly you need to convert the model. Use this page. Its based on the llama.cpp repo
https://huggingface.co/spaces/ggml-org/gguf-my-repo
And to run, you can use Ollama to run any GGUF model.