Hugging Face's logo

darthhexx
/
Qwen2.5-VL-3B-Instruct-FP8-Dynamic

Image-Text-to-Text
Transformers
Safetensors
English
qwen2_5_vl
multimodal
conversational
text-generation-inference
compressed-tensors
Model card Files Community
Qwen2.5-VL-3B-Instruct-FP8-Dynamic
File size: 158 Bytes 
095ef19
 
 
 
 
 
 
1
2
3
4
5
6
7
 
DEFAULT_stage:
  DEFAULT_modifiers:
    QuantizationModifier:
      ignore: ['re:.*lm_head', 're:visual.*']
      targets: [Linear]
      scheme: FP8_DYNAMIC