Works ok with Ollama

#1
by Iki007 - opened

Great, works ok with ollama.
Thank you!

Did you do something special to get it going in ollama?
Im getting "llama_model_load: error loading model: error loading model architecture: unknown model architecture: 'glm4'"

Nothing special, just installed the pre-release version of ollama
v0.6.6
https://github.com/ollama/ollama/releases
And simply running this command to download it

ollama run hf.co/matteogeniaccio/GLM-4-32B-0414-GGUF-fixed:Q4_K_M

Does the tool calling work for you?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment