Hugging Face's logo

DevQuasar
/
Qwen.Qwen2.5-VL-7B-Instruct-GGUF

Image-Text-to-Text
GGUF
Model card Files Community

You have to use the backend from HimariO's branch. Big thanks to add Qwen2.5VL support! Additional discussions

'Make knowledge free for everyone'

Quantized version of: Qwen/Qwen2.5-VL-7B-Instruct Buy Me a Coffee at ko-fi.com

Downloads last month
1,826
GGUF
Model size
677M params
Architecture
clip
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

32-bit

Inference Providers NEW
Image-Text-to-Text
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for DevQuasar/Qwen.Qwen2.5-VL-7B-Instruct-GGUF

Base model

Qwen/Qwen2.5-VL-7B-Instruct
Quantized
(38)
this model

Collections including DevQuasar/Qwen.Qwen2.5-VL-7B-Instruct-GGUF