Hugging Face's logo

larenspear
/
Llama3-ChatQA-1.5-8B-GGUF

GGUF
conversational
Model card Files Community
larenspear commited on
Commit
305cc16
·
1 Parent(s): e30ec08

GGUF Quantization

Browse files
Files changed (10) hide show
  1. llama3-chatqa-1.5-8b-q2_k.gguf +3 -0
  2. llama3-chatqa-1.5-8b-q3_k_l.gguf +3 -0
  3. llama3-chatqa-1.5-8b-q3_k_m.gguf +3 -0
  4. llama3-chatqa-1.5-8b-q3_k_s.gguf +3 -0
  5. llama3-chatqa-1.5-8b-q4_k_m.gguf +3 -0
  6. llama3-chatqa-1.5-8b-q4_k_s.gguf +3 -0
  7. llama3-chatqa-1.5-8b-q5_k_m.gguf +3 -0
  8. llama3-chatqa-1.5-8b-q5_k_s.gguf +3 -0
  9. llama3-chatqa-1.5-8b-q6_k.gguf +3 -0
  10. llama3-chatqa-1.5-8b-q8_0.gguf +3 -0
llama3-chatqa-1.5-8b-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:13bf9d8968b9db70ded0a9123895b6a02874d52bf34e9d46a2c7fc29fe5cc2e8
3
+ size 3179131456
llama3-chatqa-1.5-8b-q3_k_l.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:252c1d3ab8766c014940767604d0ab9231938e2181964b2445e5430938dd7f9a
3
+ size 4321956416
llama3-chatqa-1.5-8b-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05ad99cc7e31a1ff007202616dda77edb1de527628d04f6e20b18b9edcaff070
3
+ size 4018917952
llama3-chatqa-1.5-8b-q3_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6f12a530cca4c6fcc44cb1e7d0b612828089e97a5e53819c4e48ac49a36ae75
3
+ size 3664499264
llama3-chatqa-1.5-8b-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aee7b444428164159c0eeba524baa06ab3d3495fd1379b3b6f46c053a0769a63
3
+ size 4920734272
llama3-chatqa-1.5-8b-q4_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5727480aa6e7e79429726980ddafb741836e392da456e468528098dad76eae2b
3
+ size 4692668992
llama3-chatqa-1.5-8b-q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e78e1f8ef72e75a3e846bc8d3362d716d5c8d65f2d839ff1bde0a36ce0feecd
3
+ size 5732987456
llama3-chatqa-1.5-8b-q5_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10c1302f6021a4b02fb8d1a148da34638dc117574a771b970da110bb901b8a96
3
+ size 5599294016
llama3-chatqa-1.5-8b-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e33f4f06df4aeeac241e25d82a99bd31bf10ff564c7f2e94e83bc28e7de46408
3
+ size 6596006464
llama3-chatqa-1.5-8b-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcf2abd19b7e5fd8af31c7080965b970135119417ebae632cc71d200b62dfdd4
3
+ size 8540770880