shisa-ai
/

shisa-v2-llama3.1-405b-GGUF

Model card Files Files and versions Community

leonardlin commited on Jun 3

Commit

dc8ea1f

·

verified ·

1 Parent(s): fdc8df3

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -24,16 +24,16 @@ This repo contains select GGUF quants of [shisa-ai/shisa-v2-llama3.1-405b](https
 | Type    | Size (GB) |
 |:--------|----------:|
-| IQ2_XXS | 155       |
 | IQ3_XS  | 155       |
 | IQ3_M   | 170       |
 | IQ4_XS  | 202       |
 | Q4_K_M  | 227       |
 | Q8_0    | 402       |
-Graph by ikawrakow comparing some lower-quality quant PPL (lower is better) - via mradermacher:
-![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
 ## Making Quants
 ```

 | Type    | Size (GB) |
 |:--------|----------:|
+| IQ2_XXS | 100       |
 | IQ3_XS  | 155       |
 | IQ3_M   | 170       |
 | IQ4_XS  | 202       |
 | Q4_K_M  | 227       |
 | Q8_0    | 402       |
+Graph by ikawrakow comparing some lower-quality quant PPL (lower is better):
+![image.png](quantpplgraph.png)
 ## Making Quants
 ```