RedHatAI
/

OpenHermes-2.5-Mistral-7B-marlin

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

OpenHermes-2.5-Mistral-7B-marlin / quantization /apply_gptq_save_marlin.py

Commit History

Create quantization/apply_gptq_save_marlin.py

f57a0ec
verified

robertgshaw2 commited on Mar 6, 2024