Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

RedHatAI
/
Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16

Text Generation
Transformers
Safetensors
English
llama
nvidia
llama3.1
w4a16
int4
vllm
conversational
text-generation-inference
compressed-tensors
Model card Files Files and versions
xet
Community
Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16
Ctrl+K
Ctrl+K
  • 2 contributors
History: 2 commits
Eldar Kurtic
add model
59eb0db 5 months ago
  • .gitattributes
    1.57 kB
    add model 5 months ago
  • README.md
    9.7 kB
    add model 5 months ago
  • config.json
    25.7 kB
    add model 5 months ago
  • generation_config.json
    125 Bytes
    add model 5 months ago
  • model-00001-of-00008.safetensors
    4.95 GB
    xet
    add model 5 months ago
  • model-00002-of-00008.safetensors
    4.98 GB
    xet
    add model 5 months ago
  • model-00003-of-00008.safetensors
    4.98 GB
    xet
    add model 5 months ago
  • model-00004-of-00008.safetensors
    4.93 GB
    xet
    add model 5 months ago
  • model-00005-of-00008.safetensors
    4.98 GB
    xet
    add model 5 months ago
  • model-00006-of-00008.safetensors
    4.98 GB
    xet
    add model 5 months ago
  • model-00007-of-00008.safetensors
    4.98 GB
    xet
    add model 5 months ago
  • model-00008-of-00008.safetensors
    4.75 GB
    xet
    add model 5 months ago
  • model.safetensors.index.json
    210 kB
    add model 5 months ago
  • recipe.yaml
    433 Bytes
    add model 5 months ago
  • special_tokens_map.json
    296 Bytes
    add model 5 months ago
  • tokenizer.json
    17.2 MB
    xet
    add model 5 months ago
  • tokenizer_config.json
    55.2 kB
    add model 5 months ago