wenhuach commited on
Commit
51f432b
·
verified ·
1 Parent(s): d6f1700

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -2,7 +2,7 @@
2
  base_model:
3
  - Qwen/Qwen2.5-VL-7B-Instruct
4
  ---
5
- This is an example model to show how to run autoround format for visual langugae model on vLLM. Some visual modules have been quantized with 8 bits
6
 
7
  this pr https://github.com/vllm-project/vllm/pull/21802 is required.
8
 
 
2
  base_model:
3
  - Qwen/Qwen2.5-VL-7B-Instruct
4
  ---
5
+ This is an example model demonstrating how to run the AutoRound format for a visual language model on vLLM. Some visual modules have been quantized to 8-bit precision.
6
 
7
  this pr https://github.com/vllm-project/vllm/pull/21802 is required.
8