gguf not working
#13
by
prestonrhodes
- opened
Error: pull model manifest: 400: {"error":"The specified repository contains sharded GGUF. Ollama does not support this yet. Follow this issue for more info: https://github.com/ollama/ollama/issues/5245"}
prestonrhodes@mac ~ %
Error: pull model manifest: 400: {"error":"The specified repository contains sharded GGUF. Ollama does not support this yet. Follow this issue for more info: https://github.com/ollama/ollama/issues/5245"}
prestonrhodes@mac ~ %
It's a sharded GGUF. You need to merge them or use llama.cpp : https://docs.unsloth.ai/basics/deepseek-r1-0528-how-to-run-locally#running-qwen3-235b-a22b