RedHatAI
/

zephyr-7b-beta-marlin

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

zephyr-7b-beta-marlin / quantization

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

robertgshaw2's picture

Update quantization/apply_gptq_save_marlin.py

a037bbe verified about 1 year ago

apply_gptq_save_marlin.py

2.2 kB

Update quantization/apply_gptq_save_marlin.py about 1 year ago
requirements.txt

52 Bytes

Create requirements.txt about 1 year ago