Generating nothing in Ollama.

#15
by WinterFloof - opened

The model downloads and seems to run fine, but the moment I submit a prompt it generates nothing in response, just a blank space. For context, I am using hf.co/huihui-ai/Huihui-gpt-oss-20b-BF16-abliterated:Q4_K_M

I have tried other versions models derived from gpt-oss and the result is the same.

ollama version?Does Ollama support this version?

Latest version: Ollama 11.8, Though I have also been experiencing this with previous versions such as version 11.7

You need to regenerate the model with the correct template
see here
https://github.com/ollama/ollama/issues/11891#issuecomment-3208571078

Ollama now supports gpt-oss-abliterated and is currently uploading.

ollama run huihui_ai/gpt-oss-abliterated

https://ollama.com/huihui_ai/gpt-oss-abliterated

I have not been able to generate anything across 15 different downloads on ollama. Llama.ccp might have worked.

Ollama requires the latest version: https://github.com/ollama/ollama/releases/tag/v0.11.8

Sign up or log in to comment