Hugging Face's logo

prithivMLmods
/
Qwen3-4B-GGUF

Text Generation
Transformers
GGUF
English
qwen3
text-generation-inference
Mixture of Experts
conversational
Model card Files
xet
Community
prithivMLmods commited on
Commit
8066673
·
verified ·
1 Parent(s): d876e5d

Upload folder using huggingface_hub

Browse files
Files changed (9) hide show
  1. .gitattributes +8 -0
  2. Qwen3_4B.BF16.gguf +3 -0
  3. Qwen3_4B.F16.gguf +3 -0
  4. Qwen3_4B.Q3_K_M.gguf +3 -0
  5. Qwen3_4B.Q3_K_S.gguf +3 -0
  6. Qwen3_4B.Q4_K_M.gguf +3 -0
  7. Qwen3_4B.Q4_K_S.gguf +3 -0
  8. Qwen3_4B.Q5_K_M.gguf +3 -0
  9. Qwen3_4B.Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,11 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Qwen3_4B.BF16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Qwen3_4B.F16.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwen3_4B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen3_4B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Qwen3_4B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Qwen3_4B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Qwen3_4B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Qwen3_4B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3_4B.BF16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71c18ac242280876d624af6bbaabf2a66ef713c0bcc2af658debdcfcc3faec6d
3
+ size 8051285248
Qwen3_4B.F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eea612fe65c1f266354e93755ac55470c3ef9e4a2caa16a161c30ccca1644d35
3
+ size 8051285248
Qwen3_4B.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:318e5c92e932f3b749b8ae0cf26c47650a09f9298396cf981bf888d127ce71f6
3
+ size 2075618048
Qwen3_4B.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:341d87b56e17050824066e0bc0284672a82990bee7b3b9aab683bfea5a42bc5c
3
+ size 1886997248
Qwen3_4B.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fdd0b84b4b13f537f3da23b41599c76a3bd685639c36e3f318de3ac66f05f105
3
+ size 2497280768
Qwen3_4B.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48481de02d2b54b868b1bbc2e48a6dc696b79bdb94e92c44e7da47ce3bc96bc4
3
+ size 2383309568
Qwen3_4B.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d4faf49c9b0b42b98e23d09c464c12cc49afe8ad6461d418da98f1f46f15cbd
3
+ size 2889513728
Qwen3_4B.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f6a42b2cd413058df8b1bc2a9687dc1501f5b97d3c481c13be157f2a3851eca
3
+ size 4280405248