Hugging Face's logo

larenspear
/
OpenELM-3B-Instruct-GGUF

GGUF
Model card Files Community
larenspear commited on
Commit
1fc52a3
·
1 Parent(s): 3870877

GGUF Quantization

Browse files
Files changed (10) hide show
  1. openelm-3b-instruct-q2_k.gguf +3 -0
  2. openelm-3b-instruct-q3_k_l.gguf +3 -0
  3. openelm-3b-instruct-q3_k_m.gguf +3 -0
  4. openelm-3b-instruct-q3_k_s.gguf +3 -0
  5. openelm-3b-instruct-q4_k_m.gguf +3 -0
  6. openelm-3b-instruct-q4_k_s.gguf +3 -0
  7. openelm-3b-instruct-q5_k_m.gguf +3 -0
  8. openelm-3b-instruct-q5_k_s.gguf +3 -0
  9. openelm-3b-instruct-q6_k.gguf +3 -0
  10. openelm-3b-instruct-q8_0.gguf +3 -0
openelm-3b-instruct-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85db7598b58535a22047e2e0e2ff8dab46eb9138182818dee324291f889a0275
3
+ size 1150218560
openelm-3b-instruct-q3_k_l.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5dabfd985258412fec4da4ce1c585f2ba072222c8bdcbc25eca4256a897dfaca
3
+ size 1659752768
openelm-3b-instruct-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc59ea08b7b9f4377377085cb0f8b9447af27ce322e3469154c33d030c7b5d54
3
+ size 1533235520
openelm-3b-instruct-q3_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:034151390287e3e854358aa769eaa2b6f411528d78d84d25090445fd54d2b1b4
3
+ size 1344786752
openelm-3b-instruct-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae3e7cd9f6d22630eb9a8027e9c79f45d25cefd600ed189277b11127d240b88b
3
+ size 1887787328
openelm-3b-instruct-q4_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae9a93e3807f2e60f55444843617760293681b843086572baf80ea5094420365
3
+ size 1739919680
openelm-3b-instruct-q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c7704a72584216c53d2046a9619d2bdd99ef602a825414c4fc3fbcf79af023b
3
+ size 2207447360
openelm-3b-instruct-q5_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f047c38bc120398ae9e779151d3dc987412274f5e62abc55088589dec9db298c
3
+ size 2102268224
openelm-3b-instruct-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3776a1c1361b075b274a0382e7293afb0d78bf0c7e80090613489cca1978cee
3
+ size 2492485952
openelm-3b-instruct-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:feea22c1d3b5535fa9f5365a6b2dbfd6673720819554df5d5886882b8e2b6431
3
+ size 3227867456