Hugging Face's logo

RedHatAI
/
Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation
Transformers
Safetensors
llama
int8
vllm
conversational
text-generation-inference
8-bit precision
compressed-tensors
Model card Files Community
3
Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Commit History

Update README.md
8d0dcbb
verified

nm-research commited on

Update README.md
cc881d0
verified

alexmarques commited on

Update README.md
816f7dd
verified

alexmarques commited on

Update README.md
134a03a
verified

alexmarques commited on

Update README.md
382ed99
verified

alexmarques commited on

Update README.md
6feca67
verified

alexmarques commited on

Update README.md
69eb5f4
verified

alexmarques commited on

Updated compression_config to quantization_config
59e9c09
verified

mgoin commited on

Update README.md
215dd48
verified

alexmarques commited on

Upload tokenizer.json with huggingface_hub
6bf2cfa
verified

alexmarques commited on

Update README.md
218c80f
verified

alexmarques commited on

Upload tokenizer_config.json with huggingface_hub
bb6fae1
verified

alexmarques commited on

Update README.md
f3ebf1a
verified

alexmarques commited on

Update README.md
e872e9d
verified

mgoin commited on

Update README.md
dff3199
verified

alexmarques commited on

Update README.md
c402127
verified

alexmarques commited on

Update README.md
200fb5a
verified

alexmarques commited on

Update README.md
bb1df15
verified

alexmarques commited on

Update README.md
343b418
verified

alexmarques commited on

Upload folder using huggingface_hub
c1e6631
verified

alexmarques commited on

Update README.md
1677fbe
verified

alexmarques commited on

Update README.md
fc8f281
verified

alexmarques commited on

Update README.md
23e945d
verified

alexmarques commited on

Create README.md
5048a55
verified

alexmarques commited on

Upload folder using huggingface_hub
79ae16d
verified

alexmarques commited on

initial commit
05c9eb7
verified

alexmarques commited on