Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8
like
3
Follow
Red Hat AI
901
Image-Text-to-Text
Safetensors
24 languages
vllm
mistral3
neuralmagic
redhat
llmcompressor
quantized
int8
conversational
8-bit precision
compressed-tensors
arxiv:
2211.10438
arxiv:
2210.17323
License:
apache-2.0
Model card
Files
Files and versions
Community
1
2d083df
Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8
/
model-00002-of-00006.safetensors
Commit History
Upload folder using huggingface_hub
bb4e5b8
verified
alexmarques
commited on
28 days ago