Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
bartowski
/
Mistral-Small-24B-Instruct-2501-GGUF
like
110
Text Generation
GGUF
10 languages
imatrix
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
4
Use this model
c0ff467
Mistral-Small-24B-Instruct-2501-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
19 commits
bartowski
Upload Mistral-Small-24B-Instruct-2501-IQ3_M.gguf with huggingface_hub
c0ff467
verified
3 months ago
.gitattributes
2.95 kB
Upload Mistral-Small-24B-Instruct-2501-IQ3_M.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-IQ3_M.gguf
Safe
10.7 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-IQ3_M.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-IQ4_NL.gguf
Safe
13.5 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-IQ4_NL.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-IQ4_XS.gguf
Safe
12.8 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-IQ4_XS.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-Q3_K_L.gguf
Safe
12.4 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-Q3_K_L.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-Q3_K_M.gguf
Safe
11.5 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-Q3_K_M.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-Q3_K_XL.gguf
Safe
13 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-Q3_K_XL.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-Q4_0.gguf
Safe
13.5 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-Q4_0.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-Q4_1.gguf
Safe
14.9 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-Q4_1.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-Q4_K_L.gguf
Safe
14.8 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-Q4_K_L.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-Q4_K_M.gguf
Safe
14.3 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-Q4_K_M.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-Q4_K_S.gguf
Safe
13.5 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-Q4_K_S.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-Q5_K_L.gguf
Safe
17.2 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-Q5_K_L.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-Q5_K_M.gguf
Safe
16.8 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-Q5_K_M.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-Q5_K_S.gguf
Safe
16.3 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-Q5_K_S.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-Q6_K.gguf
Safe
19.3 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-Q6_K.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-Q6_K_L.gguf
Safe
19.7 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-Q6_K_L.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-Q8_0.gguf
Safe
25.1 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-Q8_0.gguf with huggingface_hub
3 months ago
Mistral-Small-24B-Instruct-2501-f16.gguf
Safe
47.2 GB
LFS
Upload Mistral-Small-24B-Instruct-2501-f16.gguf with huggingface_hub
3 months ago