Update README.md
Browse files
README.md
CHANGED
|
@@ -2,4 +2,8 @@
|
|
| 2 |
license: apache-2.0
|
| 3 |
base_model:
|
| 4 |
- Qwen/Qwen2.5-VL-32B-Instruct
|
| 5 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
license: apache-2.0
|
| 3 |
base_model:
|
| 4 |
- Qwen/Qwen2.5-VL-32B-Instruct
|
| 5 |
+
---
|
| 6 |
+
Run with:
|
| 7 |
+
```
|
| 8 |
+
vllm serve leon-se/Qwen2.5-VL-7B-Instruct-FP8-Dynamic
|
| 9 |
+
```
|