Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Mungert
/
Mistral-Small-3.1-24B-Instruct-2503-GGUF

Image-Text-to-Text
GGUF
vllm
imatrix
conversational
Model card Files Files and versions
xet
Community
1
Mistral-Small-3.1-24B-Instruct-2503-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 5 commits
Mungert's picture
Mungert
Upload Mistral-Small-3.1-24B-Instruct-2503-f16-q4_k.gguf with huggingface_hub
f5140c8 verified 3 months ago
  • .gitattributes
    1.86 kB
    Upload Mistral-Small-3.1-24B-Instruct-2503-f16-q4_k.gguf with huggingface_hub 3 months ago
  • Mistral-Small-3.1-24B-Instruct-2503-bf16-q8_0.gguf
    26.3 GB
    xet
    Upload Mistral-Small-3.1-24B-Instruct-2503-bf16-q8_0.gguf with huggingface_hub 3 months ago
  • Mistral-Small-3.1-24B-Instruct-2503-f16-q4_k.gguf
    16.1 GB
    xet
    Upload Mistral-Small-3.1-24B-Instruct-2503-f16-q4_k.gguf with huggingface_hub 3 months ago
  • Mistral-Small-3.1-24B-Instruct-2503-f16-q6_k.gguf
    20.9 GB
    xet
    Upload Mistral-Small-3.1-24B-Instruct-2503-f16-q6_k.gguf with huggingface_hub 3 months ago
  • Mistral-Small-3.1-24B-Instruct-2503-f16-q8_0.gguf
    26.3 GB
    xet
    Upload Mistral-Small-3.1-24B-Instruct-2503-f16-q8_0.gguf with huggingface_hub 3 months ago