Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,9 @@ datasets:
|
|
7 |
language:
|
8 |
- en
|
9 |
---
|
10 |
-
|
|
|
|
|
11 |
|
12 |
Was inspired after hearing about it on r/LocalLLaMA and finding out the only other quants of this model are Q4_K_M and Q8_0.
|
13 |
|
|
|
7 |
language:
|
8 |
- en
|
9 |
---
|
10 |
+
llama.cpp used for quantization: [commit a6e514a](https://github.com/ggerganov/llama.cpp/tree/a6e514a85f0fda38ff78ec91782877ea3d19ed98)
|
11 |
+
|
12 |
+
Was testing this model out and found it pretty decent for a 1.1B model. Smaller models are still stupid but can work as a basic conversational partner on low-end hardware.
|
13 |
|
14 |
Was inspired after hearing about it on r/LocalLLaMA and finding out the only other quants of this model are Q4_K_M and Q8_0.
|
15 |
|