Unable to download in Ollama - Manifest error
Unable to download in ollama
ollama run hf.co/DavidAU/Openai_gpt-oss-20b-NEO-GGUF:Q4_K_M is the option if gives you in the ollama option but does not work. I was able to manual enter Q5_1 and got it working but wanted to share
pulling manifest
Error: pull model manifest: 400: {"error":"The specified tag is not available in the repository. Please use another tag or "latest""}
OpenAI requires ah.. "odd quants" to function at 100% ish.
Although it is possible to create normal quants / imatrix ; the conversions / compressions and fallbacks mess up the quants and result in subpar performance.
Based on issues with quanting fine tunes (of OpenAI model) ; Ollama is going to need some updates / patches as the issues persist with "odd quants" with fine tunes too.