Hugging Face's logo

mradermacher
/
Qwen2.5-1.5B-Instruct-abliterated-SFT-i1-GGUF

Transformers
GGUF
English
text-generation-inference
unsloth
abliterated
uncensored
imatrix
conversational
Model card Files Community
mradermacher commited on
Commit
6316325
·
verified ·
1 Parent(s): 1ec0f59

uploaded from rich1

Browse files
Files changed (25) hide show
  1. .gitattributes +24 -0
  2. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ1_M.gguf +3 -0
  3. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ1_S.gguf +3 -0
  4. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ2_M.gguf +3 -0
  5. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ2_S.gguf +3 -0
  6. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ2_XS.gguf +3 -0
  7. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ2_XXS.gguf +3 -0
  8. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ3_M.gguf +3 -0
  9. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ3_S.gguf +3 -0
  10. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ3_XS.gguf +3 -0
  11. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ3_XXS.gguf +3 -0
  12. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ4_NL.gguf +3 -0
  13. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ4_XS.gguf +3 -0
  14. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q2_K.gguf +3 -0
  15. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q2_K_S.gguf +3 -0
  16. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q3_K_L.gguf +3 -0
  17. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q3_K_M.gguf +3 -0
  18. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q3_K_S.gguf +3 -0
  19. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q4_0.gguf +3 -0
  20. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q4_1.gguf +3 -0
  21. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q4_K_M.gguf +3 -0
  22. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q4_K_S.gguf +3 -0
  23. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q5_K_M.gguf +3 -0
  24. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q5_K_S.gguf +3 -0
  25. Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33a663f001e071ad64973b04f01e8db56033dbeb65a4afa9bcf7099ea65de616
3
+ size 464462336
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:530cf79104b1d38daac24288d1cdb0d4eeaa9cbf6783974f728e46bc6552db22
3
+ size 436528640
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4676cd4415914d5f8abb8aafe62f33c04fad193acae030dfb46029fe6333b2aa
3
+ size 601055744
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45f00d9913f11a44878c8a6a1b185f443ce4d40c744f198a58cdf293911653d7
3
+ size 563810816
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f585efa37d7a5e75f432e4d1f295b423e0e9e6177fa3e9b0b2248facfe71105
3
+ size 550327808
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6bd8ccc60d5e0b81741e9ab92e13649bb6dbd6e4477a247bc073bdf5affbb15
3
+ size 511018496
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3d9f4dd32ba45ee31f9157c87fa4879b5c792d01ce69c74dec20077865adc36
3
+ size 776665088
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06101955cd2d96ea392a8c1f7cc9f6c87192ef2e9369d675e4c730270276f47d
3
+ size 762407936
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bef2cecd892a59eac8489afb30863dc44933b5b0467d0f115cc9417f010c9e38
3
+ size 731700224
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6795d0b0345050a93f85e7a821c1df1d1fa1fb3ff28eae3b82195dfd1631a9e0
3
+ size 668793344
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3924f1afc655a5fb8b564cfd06120906206d4aae47090737da45f07a66ccfe15
3
+ size 936332288
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91d9b7ec27d96c35425c82df1ce8551e989afef9f1b9a3f00eb43c7bd1e6e3df
3
+ size 895732736
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c5e232f5c8c6dd395b100e44fd208f0f0c3e02e970698c8d73484139149d57b
3
+ size 676305920
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91f95ad14f598fbd8dc3c0f315f9e5bfdca819c3a07fcdef7ed249437c261d32
3
+ size 640136192
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:399f27139106c75cb8643b9f8188e92ba182f10a6ee6c2e492b547fdf1bd5b62
3
+ size 880163840
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e5dcc1e4d3f4d41950da6367cce4e3c9dca661087ca5d2efc88a7ca51e4e72d
3
+ size 824179712
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7127f4ab12c171abf9419be6ea47137f50b72d9fe9776d03226f884bb475daf9
3
+ size 760945664
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ac0d8e656521f7e231f72aaf5ae0c017cb0f6fea4deb2c34a214825f861aa1f
3
+ size 937536512
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3071b37eb63b89610bb574c23fd5cc8f3354ae9c43d57ddc3f50770a7548e5a
3
+ size 1016843264
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d95218aab2fc44946793642ecd3d23e50c90f86ee3a137c6fc5111d63bf7c02
3
+ size 986049536
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf336a3c0339ec3d79faaf28da5633d30e07481e96ba41bb49b444a0aa46d66c
3
+ size 940313600
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b538f98b367dc9b2f9f7a689b6c1b5d93d92af8825bef7aa6059970f87cc84c7
3
+ size 1125051392
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:883f100719f99867518dd4be737c1d3117a12103b34cf7b6f0a1c900f687523d
3
+ size 1098730496
Qwen2.5-1.5B-Instruct-abliterated-SFT.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15b78b67e051b0679d4c1e90d644a8b5a7b22f04dec28cbc9bb5b00ec64d1827
3
+ size 1272740864