Hugging Face's logo

th-nuernberg
/
DeepHermes-3-Mistral-24B-Preview-FP8-Dynamic

Text Generation
Transformers
Safetensors
English
mistral
Mistral-Small
instruct
finetune
chatml
gpt4
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
reasoning
r1
vllm
fp8
conversational
text-generation-inference
compressed-tensors
Model card Files
xet
Community
DeepHermes-3-Mistral-24B-Preview-FP8-Dynamic / recipe.yaml
tomrance's picture
tomrance
Upload folder using huggingface_hub
757ec78 verified
raw
history blame contribute delete
136 Bytes
 DEFAULT_stage:
DEFAULT_modifiers:
QuantizationModifier:
ignore: [lm_head]
targets: [Linear]
scheme: FP8_DYNAMIC