Hugging Face's logo

larenspear
/
TinyLlama-1.1B-Chat-v1.0-GGUF

Transformers
GGUF
English
conversational
Model card Files Community
larenspear commited on
Commit
1e6c1af
·
1 Parent(s): 2a4fce2

GGUF Quantizations

Browse files
Files changed (12) hide show
  1. tinyllama-1.1b-chat-v1.0-q2_k.gguf +3 -0
  2. tinyllama-1.1b-chat-v1.0-q3_k_l.gguf +3 -0
  3. tinyllama-1.1b-chat-v1.0-q3_k_m.gguf +3 -0
  4. tinyllama-1.1b-chat-v1.0-q3_k_s.gguf +3 -0
  5. tinyllama-1.1b-chat-v1.0-q4_0.gguf +3 -0
  6. tinyllama-1.1b-chat-v1.0-q4_k_m.gguf +3 -0
  7. tinyllama-1.1b-chat-v1.0-q4_k_s.gguf +3 -0
  8. tinyllama-1.1b-chat-v1.0-q5_0.gguf +3 -0
  9. tinyllama-1.1b-chat-v1.0-q5_k_m.gguf +3 -0
  10. tinyllama-1.1b-chat-v1.0-q5_k_s.gguf +3 -0
  11. tinyllama-1.1b-chat-v1.0-q6_k.gguf +3 -0
  12. tinyllama-1.1b-chat-v1.0-q8_0.gguf +3 -0
tinyllama-1.1b-chat-v1.0-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8081bd2c8cd3407da74be6dddc83395d3cba9d314cbce654df688dc86033e372
3
+ size 432131104
tinyllama-1.1b-chat-v1.0-q3_k_l.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4158002dacf75943b7978df1294c7c00118da5b443b8cd47bb417625f3474ad3
3
+ size 591526944
tinyllama-1.1b-chat-v1.0-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f06b489c94a80404225be77d6074451bcaa693b792eccc6c773a84fe22eb4d1
3
+ size 548404256
tinyllama-1.1b-chat-v1.0-q3_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efda747f7bb49fe8f64cdc1e9424caae625bc415ebf0591151cf84c0b434bee2
3
+ size 499342368
tinyllama-1.1b-chat-v1.0-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8312717a6072a710d62f87b58b2a2e293f2b4bbcab60158d7b7b1f6b8308277f
3
+ size 636726304
tinyllama-1.1b-chat-v1.0-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78cf813e20953d3665b9ef240b6ee9e0c378090f47e13c994d7af7b5e8bc016d
3
+ size 667814944
tinyllama-1.1b-chat-v1.0-q4_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d6b93a00fab3d653c61d541edf7616c1b6a887ad4fe593bc9b1498fa0d7b406
3
+ size 639872032
tinyllama-1.1b-chat-v1.0-q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27cfaccdf521c5b33c02ce2970050e7602670f455fd599d038ebc9832a9aab24
3
+ size 766028832
tinyllama-1.1b-chat-v1.0-q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:617a7589f633da5a2ba03bddff65dcf0e0c12e6354ec0d1c7057d962ee18d56a
3
+ size 782044192
tinyllama-1.1b-chat-v1.0-q5_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b867315ff2b225386d7b77aba79b11ab7a70b0f9ba893a09c0413d552718b32b
3
+ size 766028832
tinyllama-1.1b-chat-v1.0-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cfac236813c893e3d6501cd160560d98e82feb7565c54202118726578a543f92
3
+ size 903412768
tinyllama-1.1b-chat-v1.0-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f657aa369769523453d6c2be689e5c5eff8afa98e07eabe4649dc5cf4c69aa6
3
+ size 1169808416