Q3 30b A3b Pentiment - EXL2 - a allura-quants Collection

allura-quants 's Collections

Q3 8b Kintsugi - MLX

Q3 30b A3b Designant - EXL3

Q3 30b A3b Pentiment - GPTQ

Q3 30b A3b Pentiment - EXL2

Q3 30b A3b Pentiment - EXL2

updated May 22

EXL2 Quants

allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_2.5bpw_H6

Text Generation • Updated May 22 • 2
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_3.0bpw_H6

Text Generation • Updated May 22 • 2
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_3.5bpw_H6

Text Generation • Updated May 22 • 2
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_4.0bpw_H6

Text Generation • Updated May 22 • 2
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_4.5bpw_H6

Text Generation • Updated May 22 • 2
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_5.0bpw_H6

Text Generation • Updated May 22 • 2
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_6.0bpw_H6

Text Generation • Updated May 22 • 2
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_8.0bpw_H6

Text Generation • Updated May 22 • 2
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_8.0bpw_H8

Text Generation • Updated May 22 • 2