How to convert the llava to gguf format

#7
by Wangderful - opened

Hi, thank you for your useful models. I am now focusing on convert my fine-tuned llava model to gguf models including the projector model. Could you please share how did you achieve the conversion part? Thank you very much:).

Owner

take a look at the instructions on the llama.cpp repo: https://github.com/ggerganov/llama.cpp/tree/master/examples/llava#llava-16-gguf-conversion

let me know if you have questions

Sign up or log in to comment