Hugging Face's logo

mradermacher
/
Huihui-Qwen3-4B-Instruct-2507-abliterated-i1-GGUF

Transformers
GGUF
English
abliterated
uncensored
imatrix
conversational
Model card Files
xet
Community
mradermacher commited on
Commit
8153f59
·
verified ·
1 Parent(s): c4063fe

uploaded from rich1

Browse files
Files changed (25) hide show
  1. .gitattributes +24 -0
  2. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ1_M.gguf +3 -0
  3. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ1_S.gguf +3 -0
  4. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ2_M.gguf +3 -0
  5. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ2_S.gguf +3 -0
  6. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ2_XS.gguf +3 -0
  7. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ2_XXS.gguf +3 -0
  8. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ3_M.gguf +3 -0
  9. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ3_S.gguf +3 -0
  10. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ3_XS.gguf +3 -0
  11. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ3_XXS.gguf +3 -0
  12. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ4_NL.gguf +3 -0
  13. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ4_XS.gguf +3 -0
  14. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q2_K.gguf +3 -0
  15. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q2_K_S.gguf +3 -0
  16. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q3_K_L.gguf +3 -0
  17. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q3_K_M.gguf +3 -0
  18. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q3_K_S.gguf +3 -0
  19. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q4_0.gguf +3 -0
  20. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q4_1.gguf +3 -0
  21. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q4_K_M.gguf +3 -0
  22. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q4_K_S.gguf +3 -0
  23. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q5_K_M.gguf +3 -0
  24. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q5_K_S.gguf +3 -0
  25. Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Huihui-Qwen3-4B-Instruct-2507-abliterated.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Huihui-Qwen3-4B-Instruct-2507-abliterated.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cefd6b91dd3fa4e526bdcd78054ecc15bb618275dc157a21dabc0d3af00e12f4
3
+ size 1127018592
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e88caff14a630e304533cf23c2c220cad7d14ecd7c3e9612ae7990bdc75271f9
3
+ size 1055256672
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:729afd1a34e4ccadf9e8f0b3b0669ed34a7d555ff59d912fef1e7dabdbdb6b92
3
+ size 1512984672
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd3e772387192d145cc8c6d057a485a0601ff587ce4b914097611159ea263c8c
3
+ size 1417302112
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc8d039f230a520abc0cdee6e77e958efda62af5905357ba79f7e7d1d7dc1eae
3
+ size 1354100832
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2161475c28eed204c0176994a9669d479f06d531c9a9d32bb6c6a12496b601e0
3
+ size 1246621792
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44624abbba4197c78e083eb29c1e70d347b71aeca312b8ed9304b7d9969d0702
3
+ size 1962896992
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2d695e53496ad5631f4d94930000c60703845b206277fc86b2958e28804837d
3
+ size 1899531872
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8e24e16802a7072bb2e0704edd315e29e1bfeb5162d65bd9bfa6b6e9e8bef80
3
+ size 1814376032
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f7e486df2b91240a187bf5c82ef825cf9bbec03c43bce4d7d38cdce82f9f16e
3
+ size 1670189152
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:caa8566feccebb4e9a5eafb582f703d36fe54ee71b8dee1e1a4ea8c39e3e222c
3
+ size 2381344352
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f98d4c6776f868322d641911a940bbd9ad4ccc187c160b986c0975079ac72ec8
3
+ size 2270752352
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba936f7ee2c5f542f42b67b108273f669d51ef7e7401a94a16e0e366cc3e2354
3
+ size 1669500512
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82b8d2ce261724e046fa397107941f964bd581c592442cc5024224396f3a76c1
3
+ size 1563455072
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb225ffe5655e2d6ad4ec4f0f215ab9e78248b99a293552dde00fa8067109dce
3
+ size 2239786592
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ecd335efb37fc79b15fa9d0aa4c82c59a22138388758f7773f6c4d1503e227af
3
+ size 2075618912
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:730bbad40bc800ba342fc5b2710db0c7d884a8c2d8d991922196d4b386546d7c
3
+ size 1886998112
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:351bc144fcc8fefff3f8aa54bcc4912b1bb426496912fad3ea20843cada404af
3
+ size 2375773792
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:192170f8352ea5092b791109b03e52bfae161572a1348cd2f49a8f44c97e9b15
3
+ size 2596630112
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d81e713690710c86ce4c46c4b979d4bba48442ae883ba6e5e281cc8b0674ef6
3
+ size 2497281632
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3799e089bdf8d7284fb151cb3aaa8e8383c1fd6c98c0b1f3dd78027a6175594c
3
+ size 2383310432
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1656288d9dbb05e189cc1a2eaa2ffddc1acb6919aa0efc2eb2af99db971a8358
3
+ size 2889514592
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2294d1df117f15ad82ffe857e4fb00b38ec1efd12dff1658b1d774fc747bdb8a
3
+ size 2823712352
Huihui-Qwen3-4B-Instruct-2507-abliterated.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff266417bf93c6b347aab34b6a0bdfdc9f55e5a90bbd61e60d6d35638886d263
3
+ size 3306262112