Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mistral-Small-24B-Instruct-2501-GGUF
like
6
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
2
Use this model
7299526
Mistral-Small-24B-Instruct-2501-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
9 commits
MaziyarPanahi
61f56041067ee74db3abb5f655d3c1adeb714eb9e10e47e5847ef71cd41f8daf
7299526
verified
6 months ago
.gitattributes
2.16 kB
61f56041067ee74db3abb5f655d3c1adeb714eb9e10e47e5847ef71cd41f8daf
6 months ago
Mistral-Small-24B-Instruct-2501.Q2_K.gguf
Safe
8.89 GB
LFS
4c0b34d0fc3ff2c9e6b04379b64836547e7e1f2b99d7ecb8ed358445429feede
6 months ago
Mistral-Small-24B-Instruct-2501.Q3_K_L.gguf
Safe
12.4 GB
LFS
fa438cdaa313d360db90f3ab45205950b221d9cc2076673cf0b2bda174e8a75c
6 months ago
Mistral-Small-24B-Instruct-2501.Q3_K_M.gguf
Safe
11.5 GB
LFS
d9350fd9035066630a351fc56b5704f98660b2aa546e7fe1d93cc99767ae019d
6 months ago
Mistral-Small-24B-Instruct-2501.Q3_K_S.gguf
Safe
10.4 GB
LFS
f64bef4f8e9c61f497cbd71b662b6b36fcd94ec41734f939d235cb17d05318d0
6 months ago
Mistral-Small-24B-Instruct-2501.Q4_K_M.gguf
Safe
14.3 GB
LFS
2263b5df6b94aefc1822b5d41c325a84d9c215da89f3285d07de21f9cce7e797
6 months ago
Mistral-Small-24B-Instruct-2501.Q4_K_S.gguf
Safe
13.5 GB
LFS
747ff9eaf5b787e5a82851a3f8cff29ed23b61fe3314010edc7787f1e07ab533
6 months ago
Mistral-Small-24B-Instruct-2501.Q5_K_M.gguf
Safe
16.8 GB
LFS
b267a3f004de30a2b3bf36fe36416898ffb83fa184beca2d24d5cb967298d975
6 months ago
Mistral-Small-24B-Instruct-2501.Q5_K_S.gguf
Safe
16.3 GB
LFS
61f56041067ee74db3abb5f655d3c1adeb714eb9e10e47e5847ef71cd41f8daf
6 months ago
