Q3 30b A3b Designant - EXL3 - a allura-quants Collection

allura-quants 's Collections

Q3 8b Kintsugi - MLX

Q3 30b A3b Designant - EXL3

Q3 30b A3b Pentiment - GPTQ

Q3 30b A3b Pentiment - EXL2

Q3 30b A3b Designant - EXL3

updated May 26

EXL3 Quants

allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_2.5bpw_H6

Text Generation • 5B • Updated May 26 • 3
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_3.0bpw_H6

Text Generation • 6B • Updated May 26 • 3
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_3.5bpw_H6

Text Generation • 7B • Updated May 26 • 3
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_4.0bpw_H6

Text Generation • 8B • Updated May 26 • 3
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_4.5bpw_H6

Text Generation • 9B • Updated May 26 • 2
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_5.0bpw_H6

Text Generation • 10B • Updated May 26 • 3
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_6.0bpw_H6

Text Generation • 12B • Updated May 26 • 3
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_8.0bpw_H6

Text Generation • 15B • Updated May 26 • 3
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_8.0bpw_H8

Text Generation • 15B • Updated May 26 • 3