[Bug] Potential performance degradation
#6
by
AaronFeng753
- opened
https://www.reddit.com/r/LocalLLaMA/comments/1k6nuo3/glm432b_missile_command/
I'm not the OP of that post, I just saw it and tested the Missile Command game generation, and it indeed failed when using Q5_K_S model from this repo
After further testing I think this is more of a "luck", RNG issues, so I will close this issue, sorry for bothering
AaronFeng753
changed discussion status to
closed
There is however a pending fix for the template in llama https://github.com/ggml-org/llama.cpp/pull/13099