iproskurina
/

bloom-560m-GPTQ-4bit-g128

Text Generation

4-bit precision

text-generation-inference

Model card Files Files and versions Community

bloom-560m-GPTQ-4bit-g128 / README.md

Commit History

Update README.md to include GPTQModel usage.

a7a3c77
verified

iproskurina commited on 22 days ago

Update README.md to include GPTQModel usage.

850ca74
verified

iproskurina commited on 22 days ago

Update README.md

1636531
verified

iproskurina commited on Sep 24, 2024

AutoGPTQ model for bigscience/bloom-560m: 4bits, gr128, desc_act=False

d0cb3da
verified

iproskurina commited on Sep 23, 2024

Update README.md

ef9b36a
verified

iproskurina commited on Sep 23, 2024

Create README.md

4f1e777
verified

iproskurina commited on Jan 21, 2024