Update README.md
Browse files
README.md
CHANGED
|
@@ -12,6 +12,8 @@ library_name: transformers
|
|
| 12 |
|
| 13 |
# <span style="color: #7FFF7F;">Qwen2.5-VL-3B-Instruct GGUF Models</span>
|
| 14 |
|
|
|
|
|
|
|
| 15 |
|
| 16 |
## How to Use Qwen 2.5 VL Instruct with llama.cpp
|
| 17 |
|
|
|
|
| 12 |
|
| 13 |
# <span style="color: #7FFF7F;">Qwen2.5-VL-3B-Instruct GGUF Models</span>
|
| 14 |
|
| 15 |
+
These files have been built using a imatrix file and latest llama.cpp build. You must use a fork of llama.cpp to run use vision with the model.
|
| 16 |
+
|
| 17 |
|
| 18 |
## How to Use Qwen 2.5 VL Instruct with llama.cpp
|
| 19 |
|