Hugging Face's logo

unsloth
/
Mistral-Small-3.1-24B-Instruct-2503-GGUF

GGUF
vllm
mistral3
conversational
Model card Files
xet
Community
5
danielhanchen commited on
Commit
89c4427
·
verified ·
1 Parent(s): 23b14ab

Upload folder using huggingface_hub

Browse files
Files changed (6) hide show
  1. Mistral-Small-3.1-24B-Instruct-2503-Q2_K.gguf +1 -1
  2. Mistral-Small-3.1-24B-Instruct-2503-Q3_K_M.gguf +1 -1
  3. Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf +1 -1
  4. Mistral-Small-3.1-24B-Instruct-2503-Q5_K_M.gguf +1 -1
  5. Mistral-Small-3.1-24B-Instruct-2503-Q6_K.gguf +1 -1
  6. Mistral-Small-3.1-24B-Instruct-2503-UD-IQ2_XXS.gguf +1 -1
Mistral-Small-3.1-24B-Instruct-2503-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2fd23abc9f799e948c758450bb5dbf41eba0ab0f10fdd952a433ea1f76e357f5
3
  size 8890326592
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62b24def00bc6c5ad5698259bb8206a75e90ad1c9f5fd93784d8151e0737aa10
3
  size 8890326592
Mistral-Small-3.1-24B-Instruct-2503-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4aa4bb69f19451c03261d7cef3121f3f469a87d2b9132e04e77827bf87334316
3
  size 11474083392
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c04b72b1da7e0156a0689838409f99c7f1b20f83de61c87f4c8337f9a6c15b65
3
  size 11474083392
Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cf0968f01e2c45db6c2d7feb419b85b235326b909d3221e2de1b1fb5eb00ad56
3
  size 14333910592
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2
3
  size 14333910592
Mistral-Small-3.1-24B-Instruct-2503-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5e19e1a65c2bb2a3896e5e5c249e4e615f536be1f23a9131aad9ce60043fcfe1
3
  size 16763985472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb86d837fb2a839f77de002134407dfdabafb7ef7ad7120e9f963d92a8dda22c
3
  size 16763985472
Mistral-Small-3.1-24B-Instruct-2503-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:86b9b16b2bdc3ca00d97fa7c1e460de6a25cf2dcfee46fd74311e9fb42190283
3
  size 19345940032
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a2c8becfd14a96500612e98f9af5ecdc9228d4e0061bfcb976281a8c0f79f8c
3
  size 19345940032
Mistral-Small-3.1-24B-Instruct-2503-UD-IQ2_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5d350d382feb19ad70e1b5e71521a6b724b26792556d4020085c8e81f4a8c177
3
  size 6750903872
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc45815af505a4b01d16d96e5f805a00b6e3dcb63444c22f003182d1d143c979
3
  size 6750903872