Hugging Face's logo

mradermacher
/
Llama-3.1-8B-Open-SFT-GGUF

Transformers
GGUF
Safetensors
English
Chain-of-Thought Activation
Llama3.1
8B
CoT
SFT
text-generation-inference
Ollama
Question Answering
Math
Inference Endpoints
conversational
Model card Files Community
mradermacher commited on
Commit
404f009
•
1 Parent(s): 8e76ed2

uploaded from rich1

Browse files
Files changed (13) hide show
  1. .gitattributes +12 -0
  2. Llama-3.1-8B-Open-SFT.IQ4_XS.gguf +3 -0
  3. Llama-3.1-8B-Open-SFT.Q2_K.gguf +3 -0
  4. Llama-3.1-8B-Open-SFT.Q3_K_L.gguf +3 -0
  5. Llama-3.1-8B-Open-SFT.Q3_K_M.gguf +3 -0
  6. Llama-3.1-8B-Open-SFT.Q3_K_S.gguf +3 -0
  7. Llama-3.1-8B-Open-SFT.Q4_K_M.gguf +3 -0
  8. Llama-3.1-8B-Open-SFT.Q4_K_S.gguf +3 -0
  9. Llama-3.1-8B-Open-SFT.Q5_K_M.gguf +3 -0
  10. Llama-3.1-8B-Open-SFT.Q5_K_S.gguf +3 -0
  11. Llama-3.1-8B-Open-SFT.Q6_K.gguf +3 -0
  12. Llama-3.1-8B-Open-SFT.Q8_0.gguf +3 -0
  13. Llama-3.1-8B-Open-SFT.f16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Llama-3.1-8B-Open-SFT.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Llama-3.1-8B-Open-SFT.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Llama-3.1-8B-Open-SFT.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Llama-3.1-8B-Open-SFT.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Llama-3.1-8B-Open-SFT.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Llama-3.1-8B-Open-SFT.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Llama-3.1-8B-Open-SFT.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Llama-3.1-8B-Open-SFT.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Llama-3.1-8B-Open-SFT.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Llama-3.1-8B-Open-SFT.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Llama-3.1-8B-Open-SFT.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Llama-3.1-8B-Open-SFT.f16.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Open-SFT.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e043f8f153f3fb9c092da6c6847dc08d1084541db18d0a6d0099d2a160a690a5
3
+ size 4484372992
Llama-3.1-8B-Open-SFT.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00934156c54fdec71db866b75acc5a321d755c23f739e0f1735da3edf760facf
3
+ size 3179141632
Llama-3.1-8B-Open-SFT.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:367b479ee288e6b36a3bd1135a6ea53d4c573e567e5804aee9f6b512cdaa41a2
3
+ size 4321966592
Llama-3.1-8B-Open-SFT.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76d055f88a501ebfba92fa823a554495e01a1306633f8b0ef4f60c826b5a18be
3
+ size 4018928128
Llama-3.1-8B-Open-SFT.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0e26ca324e24ad57cd5d57ebb3fa8001ecf02fed2ef3e04f565163e14e8faaa
3
+ size 3664509440
Llama-3.1-8B-Open-SFT.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc0c44c6dea73804f096cc2dc22c61081d7e66a73e31048e92356c7c2636fc3f
3
+ size 4920744448
Llama-3.1-8B-Open-SFT.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cadf44f527ba8603c89712ba9f6fce324a036d7b72894f97a96ee7f0bd00fd3a
3
+ size 4692679168
Llama-3.1-8B-Open-SFT.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5765ba1c0a70b876475cfd442bf98e48711305bef09faa018bbe3951023b1a52
3
+ size 5732997632
Llama-3.1-8B-Open-SFT.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:53786167a5627bb0e646648d0006c331161d26b63229bf223987ddf09208c631
3
+ size 5599304192
Llama-3.1-8B-Open-SFT.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7143ed3c155d2fa36ea61fdaa9202dd5ae90e8995ebdbcbfcf2fcfe483621c8
3
+ size 6596016640
Llama-3.1-8B-Open-SFT.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:109cb77bea8b2888c634703b4960090ba22955f9d1d4702d748622eff5911b34
3
+ size 8540781056
Llama-3.1-8B-Open-SFT.f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62afc997bb5e9566fed6c805efb37bd88cc0d1d01bbf9e20aca4639b0e86bf4c
3
+ size 16068901376