Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8
like
3
Follow
Red Hat AI
853
Image-Text-to-Text
Safetensors
24 languages
vllm
mistral3
neuralmagic
redhat
llmcompressor
quantized
int8
conversational
8-bit precision
compressed-tensors
arxiv:
2211.10438
arxiv:
2210.17323
License:
apache-2.0
Model card
Files
Files and versions
Community
1
main
Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8
/
generation_config.json
alexmarques
Upload folder using huggingface_hub
bb4e5b8
verified
22 days ago
raw
Copy download link
history
blame
contribute
delete
Safe
116 Bytes
{
"_from_model_config"
:
true
,
"bos_token_id"
:
1
,
"eos_token_id"
:
2
,
"transformers_version"
:
"4.52.0.dev0"
}