Adding small 5-bit quantized models
Browse files- mistral-7b-q50.gguf +3 -0
- mistral-7b-q5ks.gguf +3 -0
mistral-7b-q50.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b6a210485b6a35666c926ddf49d96a1650cedad4db5697bfcf2fb50e70d763ba
|
| 3 |
+
size 4997715584
|
mistral-7b-q5ks.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c843bbf3685cb789c8733e7275a124cddbe41d06e350a983d89ecb3c23cfd254
|
| 3 |
+
size 4997715584
|