leon-se
/

Qwen2.5-VL-32B-Instruct-FP8-Dynamic

compressed-tensors

Model card Files Files and versions

Qwen2.5-VL-32B-Instruct-FP8-Dynamic / README.md

fredericodermatt's picture

fredericodermatt

Update README.md

72e634f verified 4 months ago

|

144 Bytes

metadata

license: apache-2.0
base_model:
  - Qwen/Qwen2.5-VL-32B-Instruct

Run with:

vllm serve leon-se/Qwen2.5-VL-32B-Instruct-FP8-Dynamic