You seem to have forgotten to update some of the Quants

#9
by Mikael110 - opened

The following quants were last updated 17 days ago (compared to the rest which were updated 5 days ago)

gemma-2-9b-it-IQ2_S.gguf
gemma-2-9b-it-IQ2_XS.gguf
gemma-2-9b-it-Q3_K_L-Q8.gguf
gemma-2-9b-it-Q6_K-Q8.gguf
gemma-2-9b-it-Q6_K-f32.gguf
gemma-2-9b-it-Q8_0_L.gguf

The 27B and SPPO versions also has a couple quants that are outdated.

I'd recommend either deleting them or updating them. Leaving the old quants around might lead some people to be confused about Gemma-2's quality.

Sign up or log in to comment