llama3.1 gguf format
#95
by
davidomars
- opened
We have connectivity challenges in our remote schools, so i need to download llama3.1 8B , to gguf format then use ollama to install using the model file command, kindly help with how to download in this format
Ollama let's you download GGUF files directly
We have connectivity challenges in our remote schools, so i need to download llama3.1 8B , to gguf format then use ollama to install using the model file command, kindly help with how to download in this format
Do you mean install the file elsewhere with better connectivity, then launch the existing GGUF using model file?
try using kobold.cpp, allows you to boot up a single gguf much easier.