RedHatAI
/

OpenHermes-2.5-Mistral-7B-marlin

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

OpenHermes-2.5-Mistral-7B-marlin / quantization /requirements.txt

robertgshaw2's picture

Create quantization/requirements.txt

aba357d verified about 1 year ago

history blame contribute delete

51 Bytes

	auto-gptq==0.7.1
	torch==2.2.1
	transformers
	protobuf