Hugging Face's logo

RedHatAI
/
TinyLlama-1.1B-Chat-v1.0-marlin

Text Generation
Transformers
Safetensors
llama
nm-vllm
marlin
int4
conversational
text-generation-inference
4-bit precision
gptq
Model card Files Community
TinyLlama-1.1B-Chat-v1.0-marlin
  • 2 contributors
 History: 8 commits
robertgshaw2's picture
robertgshaw2
Update quantization/apply_gptq_save_marlin.py
29715d8 verified