larenspear commited on
Commit
e2a73e0
·
1 Parent(s): c1991ce

some GGUF Quantization

Browse files
wildllama-7b-assistant-only-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:942cbc780de8cf2124e6263eeeb4b0b5c1dbec0687c3155f15f601567571d587
3
+ size 2532863872
wildllama-7b-assistant-only-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:54e6c93fac354ece01a952a0c2ffd4f4f2f5a28d828d8d54956245571295dee7
3
+ size 3298004864
wildllama-7b-assistant-only-q3_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39c79bdb79754fdfdacc960d1f546f2a21f853c687c4cc39b442330ad66395c8
3
+ size 2948304768
wildllama-7b-assistant-only-q4_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c43ad1eb27556fea9126b202c16fcc456cdd7257b29c9fca3dc81af9c06fee3
3
+ size 3856740224