Hugging Face's logo

ISTA-DASLab
/
Llama-2-70b-AQLM-4Bit-2x16-hf

Text Generation
Transformers
Safetensors
llama_aqlm
custom_code
Inference Endpoints
Model card Files Community

No model card

Downloads last month
6
Safetensors
Model size
18.2B params
Tensor type
F32
·
I16
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Collection including ISTA-DASLab/Llama-2-70b-AQLM-4Bit-2x16-hf