Hugging Face's logo

unsloth
/
Mistral-Small-3.1-24B-Instruct-2503-GGUF

GGUF
vllm
mistral3
conversational
Model card Files
xet
Community
5
danielhanchen commited on
Commit
5a38b44
·
verified ·
1 Parent(s): 1bc218d

Add files using upload-large-folder tool

Browse files
Files changed (6) hide show
  1. .gitattributes +2 -0
  2. Mistral-Small-3.1-24B-Instruct-2503-Q4_K_S.gguf +3 -0
  3. Mistral-Small-3.1-24B-Instruct-2503-Q5_K_S.gguf +3 -0
  4. Mistral-Small-3.1-24B-Instruct-2503-UD-Q5_K_XL.gguf +2 -2
  5. Mistral-Small-3.1-24B-Instruct-2503-UD-Q6_K_XL.gguf +2 -2
  6. Mistral-Small-3.1-24B-Instruct-2503-UD-Q8_K_XL.gguf +2 -2
.gitattributes CHANGED
@@ -61,3 +61,5 @@ Mistral-Small-3.1-24B-Instruct-2503-UD-Q5_K_XL.gguf filter=lfs diff=lfs merge=lf
61
  Mistral-Small-3.1-24B-Instruct-2503-UD-Q6_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
62
  Mistral-Small-3.1-24B-Instruct-2503-UD-Q8_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
63
  mmproj-BF16.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
61
  Mistral-Small-3.1-24B-Instruct-2503-UD-Q6_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
62
  Mistral-Small-3.1-24B-Instruct-2503-UD-Q8_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
63
  mmproj-BF16.gguf filter=lfs diff=lfs merge=lfs -text
64
+ Mistral-Small-3.1-24B-Instruct-2503-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
65
+ Mistral-Small-3.1-24B-Instruct-2503-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-3.1-24B-Instruct-2503-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2caa8ec0139b698c5701b2759c9ffb6a0734ee7264b694a3fe5520bb636264d
3
+ size 13549280832
Mistral-Small-3.1-24B-Instruct-2503-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83ad3caf2e0d13067485ad8303d1f6641752a0caf780174c84231385d77bae11
3
+ size 16304414272
Mistral-Small-3.1-24B-Instruct-2503-UD-Q5_K_XL.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:86463a1c81af5b796a19b1083c9149d5fcbe7b940ab0203f57e5530c5d151fa1
3
- size 16765825952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e1ad50456f49478a64d3fc151c438c1661c2461ba9a419286bd8899038d1ec8
3
+ size 16788110912
Mistral-Small-3.1-24B-Instruct-2503-UD-Q6_K_XL.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c3f484d0bde9ded04b3d2ed477b2d1aa3be42d009b5a4b5bae9f651028501604
3
- size 20788384672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0245a08a30df79c722269e97c82698c672e75976355898661e5a1ff6b93953b1
3
+ size 20788387392
Mistral-Small-3.1-24B-Instruct-2503-UD-Q8_K_XL.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e922c1ab3e1550a5f733a5b5dac7bed3d6a134ec33a865ffac3d1d8adfe946ee
3
- size 28991853472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e59f282ceea6f2e73559ff5ad87ad8848f6f979f908b1ff0f0bfd6718cf2bd37
3
+ size 28991856192