Q5_K_M vs Q5_K_L vs Q5_K_XL

#4
by ChuckMcSneed - opened

What's the difference in PPL?

Unsloth AI org

What's the difference in PPL?

Uusually we'd recommend people to use the XL quants as theyre dynamic whilst K_M isn't

Sign up or log in to comment