Works ok with Ollama
#1
by
Iki007
- opened
Great, works ok with ollama.
Thank you!
Did you do something special to get it going in ollama?
Im getting "llama_model_load: error loading model: error loading model architecture: unknown model architecture: 'glm4'"
Nothing special, just installed the pre-release version of ollama
v0.6.6
https://github.com/ollama/ollama/releases
And simply running this command to download it
ollama run hf.co/matteogeniaccio/GLM-4-32B-0414-GGUF-fixed:Q4_K_M
Does the tool calling work for you?