GGUF
English
Inference Endpoints
Crataco commited on
Commit
3f4a2c3
1 Parent(s): c397b02

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -7,7 +7,9 @@ datasets:
7
  language:
8
  - en
9
  ---
10
- Was testing this model out and found it pretty decent for a 1.1B model. Smaller models are still stupid but can work as a conversational partner on low-end hardware.
 
 
11
 
12
  Was inspired after hearing about it on r/LocalLLaMA and finding out the only other quants of this model are Q4_K_M and Q8_0.
13
 
 
7
  language:
8
  - en
9
  ---
10
+ llama.cpp used for quantization: [commit a6e514a](https://github.com/ggerganov/llama.cpp/tree/a6e514a85f0fda38ff78ec91782877ea3d19ed98)
11
+
12
+ Was testing this model out and found it pretty decent for a 1.1B model. Smaller models are still stupid but can work as a basic conversational partner on low-end hardware.
13
 
14
  Was inspired after hearing about it on r/LocalLLaMA and finding out the only other quants of this model are Q4_K_M and Q8_0.
15