Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mistral-NeMo-Minitron-8B-Instruct-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Use this model
refs/pr/1
Mistral-NeMo-Minitron-8B-Instruct-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
7 commits
MaziyarPanahi
7a4ac2be2d010501c90cecbee8361a890cbb52d1bffdf867673e7a24b1a66619
9f577db
verified
7 months ago
.gitattributes
Safe
2.01 kB
7a4ac2be2d010501c90cecbee8361a890cbb52d1bffdf867673e7a24b1a66619
7 months ago
Mistral-NeMo-Minitron-8B-Instruct-GGUF_imatrix.dat
5.78 MB
LFS
7a4ac2be2d010501c90cecbee8361a890cbb52d1bffdf867673e7a24b1a66619
7 months ago
Mistral-NeMo-Minitron-8B-Instruct.Q5_K_M.gguf
Safe
6 GB
LFS
849ab006c1ea3adfd33a8c36f15215a3b4b128d98cf4ed8ee3ad1d2abfff5bde
7 months ago
Mistral-NeMo-Minitron-8B-Instruct.Q5_K_S.gguf
Safe
5.86 GB
LFS
5157a8b4ffdae7a7c61cb6fa83b672146adc05887538b53d1f35e7ebfacd7e60
7 months ago
Mistral-NeMo-Minitron-8B-Instruct.Q6_K.gguf
Safe
6.91 GB
LFS
537569048ef565b3d1fb161305888ea12f5440b446fd8daad782cd2eb7ba4a01
7 months ago
Mistral-NeMo-Minitron-8B-Instruct.Q8_0.gguf
Safe
8.95 GB
LFS
58efd2c1b75a3247665afd0a3614265678d0f20d284678713c9a44a1aecf4ae4
7 months ago
Mistral-NeMo-Minitron-8B-Instruct.fp16.gguf
Safe
16.8 GB
LFS
caba3378f4a66843b7e27c48cd9dee91c121752e4c48e7c54c9e78d53dc475cb
7 months ago
README.md
Safe
3.1 kB
7a4ac2be2d010501c90cecbee8361a890cbb52d1bffdf867673e7a24b1a66619
7 months ago
