the error most likely indicates that models architecture isnt directly recognized by conversion script have you tried "python convert-hf-to-gguf.py /path/to/model --outtype f16" ?

these links might help: https://github.com/ggerganov/llama.cpp#obtain-and-prepare-the-model-files

for transforming it https://huggingface.co/docs/transformers/index

https://ollama.com/