Update README.md
Browse filesadded link to mlx-4bit version
README.md
CHANGED
|
@@ -21,6 +21,8 @@ pipeline_tag: text-generation
|
|
| 21 |
|
| 22 |
SnakModel comes as an instruction-tuned, and a base version. In addition, each model includes intermediate checkpoints (under model revisions).
|
| 23 |
|
|
|
|
|
|
|
| 24 |
**Input**
|
| 25 |
|
| 26 |
Text only, with instructions following the `[INST] {instruction} [/INST]` template.
|
|
|
|
| 21 |
|
| 22 |
SnakModel comes as an instruction-tuned, and a base version. In addition, each model includes intermediate checkpoints (under model revisions).
|
| 23 |
|
| 24 |
+
For running the model locally, we also provide a 4-bit quantized version optimized for Apple Silicon under [NLPnorth/snakmodel-7b-instruct-mlx-4bit/](https://huggingface.co/NLPnorth/snakmodel-7b-instruct-mlx-4bit/).
|
| 25 |
+
|
| 26 |
**Input**
|
| 27 |
|
| 28 |
Text only, with instructions following the `[INST] {instruction} [/INST]` template.
|