Qwen
/

Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

model = Qwen2_5_VLForConditionalGeneration.from_pretrained( "Qwen/Qwen2.5-VL-3B-Instruct-AWQ", torch_dtype="auto", device_map="auto" )

#6 opened 2 days ago by

Can Qwen team share the source code for AWQ?

#5 opened about 2 months ago by

Update README.md

#4 opened 2 months ago by

Would it be possible to provide a GGUF file for the Qwen2.5-VL-3B model?

#3 opened 3 months ago by

How much VRAM is required

#2 opened 3 months ago by

Add link to paper and Github repo

#1 opened 4 months ago by