Benefits of unsloth/Q5_K_XL UD vs bartowski/Q5_K_L (current releases) ?
Greetings! LM Studio user here ... I tend to prefer Unsloth UD models but LMS search is indicating Bartowski's has more likes and downloads for GLM-4-32B-0414.
Can you share any thoughts on how the two models compare? If not at this quant level, then general fundamental differences would be great to hear too.
Not looking for a bashing session, just some info to help me learn some differences between the two. May also serve as a learning opportunity for me to learn to better-read the model cards.
Thanks in advance and keep up the great work!
Unsloth uses dynamic quants and different imatrix dataset.
@davidpfarrell use whichever you prefer. I think you should download both and see which you like better :)
Also we uploaded our one just about 2 weeks ago so that probably explains why
danielhanchen@davidpfarrell @YearZero we reuploaded the quants btw with llama.cpp fixes. please use --jinja
If you don't use
--jinja, which applies the chat template, then you will get gibberish!
Results should be much better so let us know!:
./llama.cpp/llama-cli -hf unsloth/GLM-4-32B-0414-GGUF:Q4_K_XL -ngl 99 --jinja
Thank you!