Hugging Face's logo

unsloth
/
Mistral-Small-3.1-24B-Instruct-2503-GGUF

GGUF
vllm
mistral3
conversational
Model card Files
xet
Community
5
danielhanchen commited on
Commit
23b14ab
·
verified ·
1 Parent(s): 629ea3c

Upload folder using huggingface_hub

Browse files
Files changed (9) hide show
  1. Mistral-Small-3.1-24B-Instruct-2503-UD-IQ1_M.gguf +1 -1
  2. Mistral-Small-3.1-24B-Instruct-2503-UD-IQ1_S.gguf +1 -1
  3. Mistral-Small-3.1-24B-Instruct-2503-UD-IQ2_M.gguf +1 -1
  4. Mistral-Small-3.1-24B-Instruct-2503-UD-IQ3_XXS.gguf +1 -1
  5. Mistral-Small-3.1-24B-Instruct-2503-UD-Q2_K_XL.gguf +1 -1
  6. Mistral-Small-3.1-24B-Instruct-2503-UD-Q3_K_XL.gguf +1 -1
  7. Mistral-Small-3.1-24B-Instruct-2503-UD-Q4_K_XL.gguf +2 -2
  8. mmproj-F16.gguf +2 -2
  9. mmproj-F32.gguf +2 -2
Mistral-Small-3.1-24B-Instruct-2503-UD-IQ1_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0b75cf1a91d0274c5866c06317b42a8b8df5b7ba6ff8ec76285c2231014fc447
3
  size 6017310272
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b5a941a8720217920e0a1e13487beb2ccadbf037f349a8ada7de2bb4f3cbe50
3
  size 6017310272
Mistral-Small-3.1-24B-Instruct-2503-UD-IQ1_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:555da76a53d17fd7f9ba52f004fe17577a36f23ebd1d386c4f84e85f53e1c270
3
  size 5558558272
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:512d835c4d43982bb9388997f546678acee814839f1cd5171960f2c5c4a4634a
3
  size 5558558272
Mistral-Small-3.1-24B-Instruct-2503-UD-IQ2_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f1a35973fb6d0c38eb02515108e585a8b8fe3ca0efa192d2885f9f0fc203dd44
3
  size 8243322432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d65ba98838d2e78e5ae3597bcf91a8af056826dcc6206e874fd7fe97ce0c297
3
  size 8243322432
Mistral-Small-3.1-24B-Instruct-2503-UD-IQ3_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cd802cfd1338a8e31bf887ae5db45742a5ff20c3e210b056430c3069b84a7354
3
  size 9409207872
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4c9ae36e5e22f0a3da7aba9f7cdeeb2d36054644f0a3c720d7155670858d2fa
3
  size 9409207872
Mistral-Small-3.1-24B-Instruct-2503-UD-Q2_K_XL.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f7f0b8818d3d34bd2e5d08e58a3b062c0b899f4402408071de87eb321d76c339
3
  size 9292144192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:810e3a839c70656e27fe30f38a4e3ec7b01fc3be5752ce206c7bbaa423f40f91
3
  size 9292144192
Mistral-Small-3.1-24B-Instruct-2503-UD-Q3_K_XL.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f5056d8d2ba73ed1d646430aa5ab5669ce6c294dd65e1071e2a398eabcd18b5c
3
  size 11850874432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4260f805d21c1645011619616a6a0117ea3c1340cd5081d54127c0c7b4c31b81
3
  size 11850874432
Mistral-Small-3.1-24B-Instruct-2503-UD-Q4_K_XL.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e4e87ad817484ea3c71b78fcbabe9c8f46d78f0c0d8bf107883e180da66feeb0
3
- size 14548868672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d73fe8035c425d6828bf737a8ffc735de1f8968613151cc8f77ac5a213c6c37
3
+ size 14505614912
mmproj-F16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:724d8fcdafcd29f36114ac289ac88f7900e6fae4fc31e86db298a42a91a21954
3
- size 878053472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7483fdcc0e9199812f3b333ea4c09615f1a4b036dedd3244dcc1ed4f9aa4c22c
3
+ size 878053440
mmproj-F32.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:217ef4a1677b095fd9d5c8a03308ede4006845c0e90cfb83684d7a520c027ccb
3
- size 1755867232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f497900a001a6a6251d1543516c3362946b3f6f9c4cf3fa77285e00c1845ce63
3
+ size 1755867200