Hugging Face's logo

bullerwins
/
Qwen2.5-7B-Instruct-GGUF

Text Generation
Transformers
GGUF
chat
conversational
Model card Files
xet
Community
1
bullerwins commited on
Commit
97a1aae
·
verified ·
1 Parent(s): a6fc7ba

Add files using upload-large-folder tool

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. Qwen2.5-7B-Instruct-Q3_K_L.gguf +3 -0
  3. Qwen2.5-7B-Instruct-Q3_K_M.gguf +3 -0
  4. Qwen2.5-7B-Instruct-Q3_K_S.gguf +3 -0
  5. Qwen2.5-7B-Instruct-Q4_K_M.gguf +3 -0
  6. Qwen2.5-7B-Instruct-Q4_K_S.gguf +3 -0
  7. Qwen2.5-7B-Instruct-Q5_K_M.gguf +3 -0
  8. Qwen2.5-7B-Instruct-Q5_K_S.gguf +3 -0
  9. Qwen2.5-7B-Instruct-Q6_K.gguf +3 -0
  10. Qwen2.5-7B-Instruct-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,12 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Qwen2.5-7B-Instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Qwen2.5-7B-Instruct-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwen2.5-7B-Instruct-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen2.5-7B-Instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Qwen2.5-7B-Instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Qwen2.5-7B-Instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Qwen2.5-7B-Instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Qwen2.5-7B-Instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Qwen2.5-7B-Instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-7B-Instruct-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c909a7d7d3fe9074597bf293d776a63a8efbbbb3e740a483dab865d3ffa6839e
3
+ size 4088459680
Qwen2.5-7B-Instruct-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e69161e57ba46032ebffb93c2565a878db473af6a32a0f9383ffe53d14884f4
3
+ size 3808391584
Qwen2.5-7B-Instruct-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50658c7a92705dc8633671a3ca393193e2723120d1ecaca66fb70656fb4c91a7
3
+ size 3492368800
Qwen2.5-7B-Instruct-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a6cd3ed1e9aa78637bb8b2713555b0c2d608867900dab7eb18884373705c972
3
+ size 4683073952
Qwen2.5-7B-Instruct-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7b78ecff3eee0db1c8fa30b1b738e247e5bbee004e0a85ca5f02a7b6b676da4
3
+ size 4457769376
Qwen2.5-7B-Instruct-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34428d0b049249e0f365e38020eafb4962ddd7a7d303c1b6062c3d95e19e891f
3
+ size 5444831648
Qwen2.5-7B-Instruct-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d04b9cb98c611526a9f83d208074230f78f5520171dd3b51b04547fc4453dd88
3
+ size 5315176864
Qwen2.5-7B-Instruct-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7a6ffc51649a4db8678d1240a05a71acbd36aa4e48cae5460b720ed034cd54d
3
+ size 6254199200
Qwen2.5-7B-Instruct-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bfb43fdcb693fd6d650900c6595be1c23e022c35afadba511949dcc26b3625f1
3
+ size 8098525600