by soundTeam, thanks <3
Allura (Quants)
community
AI & ML interests
luxury automated space communism in eight to two bits (pfp by legendknit.bsky.social <3)
Recent Activity
View all activity
EXL3 Quants
-
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_2.5bpw_H6
Text Generation ⢠5B ⢠Updated ⢠3 -
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_3.0bpw_H6
Text Generation ⢠6B ⢠Updated ⢠3 -
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_3.5bpw_H6
Text Generation ⢠7B ⢠Updated ⢠3 -
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_4.0bpw_H6
Text Generation ⢠8B ⢠Updated ⢠3
EXL2 Quants
-
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_2.5bpw_H6
Text Generation ⢠Updated ⢠2 -
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_3.0bpw_H6
Text Generation ⢠Updated ⢠2 -
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_3.5bpw_H6
Text Generation ⢠Updated ⢠2 -
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_4.0bpw_H6
Text Generation ⢠Updated ⢠2
by soundTeam, thanks <3
EXL3 Quants
-
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_2.5bpw_H6
Text Generation ⢠5B ⢠Updated ⢠3 -
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_3.0bpw_H6
Text Generation ⢠6B ⢠Updated ⢠3 -
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_3.5bpw_H6
Text Generation ⢠7B ⢠Updated ⢠3 -
allura-quants/allura-org_Q3-30B-A3B-Designant_EXL3_4.0bpw_H6
Text Generation ⢠8B ⢠Updated ⢠3
GPTQ quants made with both GPTQModel and Autoround (PSA, may not work ootb in vLLM --- working on it)
EXL2 Quants
-
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_2.5bpw_H6
Text Generation ⢠Updated ⢠2 -
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_3.0bpw_H6
Text Generation ⢠Updated ⢠2 -
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_3.5bpw_H6
Text Generation ⢠Updated ⢠2 -
allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL2_4.0bpw_H6
Text Generation ⢠Updated ⢠2