Benefits of unsloth/Q5_K_XL UD vs bartowski/Q5_K_L (current releases) ?

#7
by davidpfarrell - opened

Greetings! LM Studio user here ... I tend to prefer Unsloth UD models but LMS search is indicating Bartowski's has more likes and downloads for GLM-4-32B-0414.

Can you share any thoughts on how the two models compare? If not at this quant level, then general fundamental differences would be great to hear too.

Not looking for a bashing session, just some info to help me learn some differences between the two. May also serve as a learning opportunity for me to learn to better-read the model cards.

Thanks in advance and keep up the great work!

Unsloth uses dynamic quants and different imatrix dataset.

Unsloth AI org

@davidpfarrell use whichever you prefer. I think you should download both and see which you like better :)

Unsloth AI org

Also we uploaded our one just about 2 weeks ago so that probably explains why

Sign up or log in to comment