isogen
/

Jan-v1-4B-exl3-8bpw-h8

8-bit precision

Model card Files Files and versions

isogen commited on 3 days ago

Commit

19f2af5

·

verified ·

1 Parent(s): 0697f2f

Update README.md

Files changed (1) hide show

README.md +5 -5

README.md CHANGED Viewed

@@ -6,8 +6,8 @@ base_model: janhq/Jan-v1-4B
 ### HumanEval (argmax)
-| Model                                                                | Q4   | Q6   | Q8   | FP16 |
-| -------------------------------------------------------------------- | ---- | ---- | ---- | ---- |
-| [Jan-v1-4B-4bpw](https://huggingface.co/isogen/Jan-v1-4B-4bpw)       | 82.3 | 79.3 | 78.0 | 78.0 |
-| [Jan-v1-4B-6bpw](https://huggingface.co/isogen/Jan-v1-4B-6bpw)       | 78.0 | 76.8 | 77.4 | 76.8 |
-| [Jan-v1-4B-8bpw-h8](https://huggingface.co/isogen/Jan-v1-4B-8bpw-h8) | 79.9 | 78.7 | 78.0 | 77.4 |

 ### HumanEval (argmax)
+| Model                                                                          | Q4   | Q6   | Q8   | FP16 |
+| ------------------------------------------------------------------------------ | ---- | ---- | ---- | ---- |
+| [Jan-v1-4B-exl3-4bpw](https://huggingface.co/isogen/Jan-v1-4B-exl3-4bpw)       | 82.3 | 79.3 | 78.0 | 78.0 |
+| [Jan-v1-4B-exl3-6bpw](https://huggingface.co/isogen/Jan-v1-4B-exl3-6bpw)       | 78.0 | 76.8 | 77.4 | 76.8 |
+| [Jan-v1-4B-exl3-8bpw-h8](https://huggingface.co/isogen/Jan-v1-4B-exl3-8bpw-h8) | 79.9 | 78.7 | 78.0 | 77.4 |