Why so few 8 bit capable models?
1
#13 opened about 2 years ago
by
ibivibiv
Can Run "gptq_model-4bit--1g" but not "gptq-4bit-32g-actorder_True"
#12 opened about 2 years ago
by
0-hero
comparison with bitsandbytes nf4, hope to increase GPTQ accuracy
12
#11 opened about 2 years ago
by
AIReach
Mininum VRAM?
7
#9 opened about 2 years ago
by
hierholzer
GGML version possible/coming?
2
#8 opened about 2 years ago
by
Thireus
vram requirements
👍
1
1
#5 opened about 2 years ago
by
joujiboi