ISTA-DASLab
/

Meta-Llama-3-70B-AQLM-2Bit-1x16

Text Generation

text-generation-inference

Model card Files Files and versions Community

Meta-Llama-3-70B-AQLM-2Bit-1x16

Ctrl+K

Ctrl+K

1 contributor

History: 9 commits

SpiridonSunRotator's picture

SpiridonSunRotator

Updated metrics

ddb56ce verified about 1 year ago

.gitattributes

1.52 kB

initial commit about 1 year ago
README.md

711 Bytes

Updated metrics about 1 year ago
config.json

9.38 kB

Uploaded improved version of quantized model about 1 year ago
generation_config.json

126 Bytes

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization about 1 year ago
model-00001-of-00005.safetensors

5 GB
LFS

Uploaded improved version of quantized model about 1 year ago
model-00002-of-00005.safetensors

4.96 GB
LFS

Uploaded improved version of quantized model about 1 year ago
model-00003-of-00005.safetensors

4.99 GB
LFS

Uploaded improved version of quantized model about 1 year ago
model-00004-of-00005.safetensors

4.87 GB
LFS

Uploaded improved version of quantized model about 1 year ago
model-00005-of-00005.safetensors

2.1 GB
LFS

Uploaded improved version of quantized model about 1 year ago
model.safetensors.index.json

152 kB

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization about 1 year ago
special_tokens_map.json

73 Bytes

Uploaded tokenizer about 1 year ago
tokenizer.json

9.08 MB

Uploaded tokenizer about 1 year ago
tokenizer_config.json

50.6 kB

Uploaded tokenizer about 1 year ago