GGUF
#4
by
mcchung52
- opened
can someone pls make the GGUF version?
Hi
@mcchung52
, Apologies for the late reply, Creating a GGUF version of google/paligemma2-10b-mix-448 involves a multi-step process, as GGUF is a specific format optimized for llama.cpp and similar local inference engines.
Kindly refer this link in this page explains what GGUF is and how to find/use GGUF models on the Hugging Face Hub. It also points to the llama.cpp conversion process.
If you have any concerns let us know will assist you. Thank you.