Update README.md
Browse files
README.md
CHANGED
@@ -2,7 +2,7 @@
|
|
2 |
base_model:
|
3 |
- Qwen/Qwen2.5-VL-7B-Instruct
|
4 |
---
|
5 |
-
This is an example model
|
6 |
|
7 |
this pr https://github.com/vllm-project/vllm/pull/21802 is required.
|
8 |
|
|
|
2 |
base_model:
|
3 |
- Qwen/Qwen2.5-VL-7B-Instruct
|
4 |
---
|
5 |
+
This is an example model demonstrating how to run the AutoRound format for a visual language model on vLLM. Some visual modules have been quantized to 8-bit precision.
|
6 |
|
7 |
this pr https://github.com/vllm-project/vllm/pull/21802 is required.
|
8 |
|