Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mistral-Small-Instruct-2409-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
2
Use this model
2ebf0a3
Mistral-Small-Instruct-2409-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
12 commits
MaziyarPanahi
730837680b5daa7ba323b133e86385d1b1d3fddb34baaa2ef661caeb6dc755a2
2ebf0a3
verified
8 months ago
.gitattributes
Safe
2.81 kB
Upload folder using huggingface_hub (#1)
12 months ago
Mistral-Small-Instruct-2409-GGUF_imatrix.dat
11.9 MB
LFS
Upload folder using huggingface_hub (#1)
12 months ago
Mistral-Small-Instruct-2409.IQ1_M.gguf
Safe
5.27 GB
LFS
Upload folder using huggingface_hub (#1)
12 months ago
Mistral-Small-Instruct-2409.IQ1_S.gguf
Safe
4.83 GB
LFS
Upload folder using huggingface_hub (#1)
12 months ago
Mistral-Small-Instruct-2409.IQ2_XS.gguf
Safe
6.65 GB
LFS
Upload folder using huggingface_hub (#1)
12 months ago
Mistral-Small-Instruct-2409.IQ3_XS.gguf
Safe
9.18 GB
LFS
Upload folder using huggingface_hub (#1)
12 months ago
Mistral-Small-Instruct-2409.IQ4_XS.gguf
Safe
11.9 GB
LFS
Upload folder using huggingface_hub (#1)
12 months ago
Mistral-Small-Instruct-2409.Q2_K.gguf
Safe
8.27 GB
LFS
0d28c3482790df1284f9e2e7e1fbf8f7a364619ab1593ed5528eb75d7a77b92d
8 months ago
Mistral-Small-Instruct-2409.Q3_K_L.gguf
Safe
11.7 GB
LFS
346eb1d1d5ae2b7b964d8b5a9a97538e1675c1e6304ef9d599995f977a57f427
8 months ago
Mistral-Small-Instruct-2409.Q3_K_M.gguf
Safe
10.8 GB
LFS
ad5a361c29248d05bbe2fda452fef26f8b5eedbd55d7be788122767140a6ccd8
8 months ago
Mistral-Small-Instruct-2409.Q3_K_S.gguf
Safe
9.64 GB
LFS
f15b7abc9e09613cf7931447a8a74469c1ca8a36d13f05cfd4428872db89c631
8 months ago
Mistral-Small-Instruct-2409.Q4_K_M.gguf
Safe
13.3 GB
LFS
40ae70d9124b6e3da01a72a8d3070d8c5895845e781ce319d30d8536c6372ad8
8 months ago
Mistral-Small-Instruct-2409.Q4_K_S.gguf
Safe
12.7 GB
LFS
6b10d62a7b97013fa426776ce5d0e301a7734fab3414c84acd449950488f0d49
8 months ago
Mistral-Small-Instruct-2409.Q5_K_M.gguf
Safe
15.7 GB
LFS
9063e603d56a619f37bd57820de4b7e3b798fc50f3c10f0f69f012a01cc0e8c5
8 months ago
Mistral-Small-Instruct-2409.Q5_K_S.gguf
Safe
15.3 GB
LFS
743142d8bc7697065359f49e94ed56b82c20cf554c94696b9c1b7f39bf016e2f
8 months ago
Mistral-Small-Instruct-2409.Q6_K.gguf
Safe
18.3 GB
LFS
730837680b5daa7ba323b133e86385d1b1d3fddb34baaa2ef661caeb6dc755a2
8 months ago
Mistral-Small-Instruct-2409.Q8_0.gguf
Safe
23.6 GB
LFS
Upload folder using huggingface_hub (#1)
12 months ago
Mistral-Small-Instruct-2409.fp16.gguf
44.5 GB
LFS
Upload folder using huggingface_hub (#1)
12 months ago
README.md
Safe
3.06 kB
Upload folder using huggingface_hub (#1)
12 months ago
config.json
Safe
31 Bytes
Upload folder using huggingface_hub
12 months ago
