Hugging Face's logo

turboderp
/
Cat-Llama-3-70B-instruct-exl2

Model card Files Community
1
Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

EXL2 quants of Cat Llama-3 70B instruct

2.50 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight

measurement.json

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model's library. Check the docs .