Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
Llama-3.1-Nemotron-Nano-8B-v1-GGUF
like
4
Text Generation
Transformers
GGUF
PyTorch
English
nvidia
llama-3
imatrix
conversational
arxiv:
2502.00203
License:
nvidia-open-model-license
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
362dcb5
Llama-3.1-Nemotron-Nano-8B-v1-GGUF
1 contributor
History:
21 commits
Mungert
Upload Llama-3.1-Nemotron-Nano-8B-v1-q5_k_m.gguf with huggingface_hub
362dcb5
verified
16 days ago
.gitattributes
3.01 kB
Upload Llama-3.1-Nemotron-Nano-8B-v1-q5_k_m.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-bf16-q4_k.gguf
6.3 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-bf16-q4_k.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-bf16-q6_k.gguf
7.84 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-bf16-q6_k.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-bf16-q8_0.gguf
9.53 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-bf16-q8_0.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-bf16.gguf
16.1 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-bf16.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-f16-q4_k.gguf
6.3 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-f16-q4_k.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-f16-q6_k.gguf
7.84 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-f16-q6_k.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-f16-q8_0.gguf
9.53 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-f16-q8_0.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-f16.gguf
16.1 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-f16.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-q2_k_l.gguf
3.69 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-q2_k_l.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-q3_k_l.gguf
4.48 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-q3_k_l.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-q3_k_m.gguf
4.02 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-q3_k_m.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-q3_k_s.gguf
3.66 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-q3_k_s.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-q4_k_l.gguf
5.31 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-q4_k_l.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-q4_k_m.gguf
4.92 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-q4_k_m.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-q4_k_s.gguf
4.69 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-q4_k_s.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-q5_k_l.gguf
6.06 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-q5_k_l.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-q5_k_m.gguf
5.73 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-q5_k_m.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-q5_k_s.gguf
5.6 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-q5_k_s.gguf with huggingface_hub
16 days ago
Llama-3.1-Nemotron-Nano-8B-v1-q6_k_l.gguf
6.85 GB
LFS
Upload Llama-3.1-Nemotron-Nano-8B-v1-q6_k_l.gguf with huggingface_hub
16 days ago
README.md
20.1 kB
Upload README.md with huggingface_hub
16 days ago
