update vllm guide
Browse files
vllm_plugin_meralion/README.md
CHANGED
|
@@ -1,5 +1,8 @@
|
|
| 1 |
## MERaLiON-AudioLLM vLLM Serving
|
| 2 |
|
|
|
|
|
|
|
|
|
|
| 3 |
### Set up Environment
|
| 4 |
|
| 5 |
MERaLiON-AudioLLM requires vLLM version `0.6.4.post1` and transformers `4.46.3`
|
|
|
|
| 1 |
## MERaLiON-AudioLLM vLLM Serving
|
| 2 |
|
| 3 |
+
> [!IMPORTANT]
|
| 4 |
+
> MERaLiON-AudioLLM is trained on 30s audios. This vllm integration supports at most 4mins audio input.
|
| 5 |
+
|
| 6 |
### Set up Environment
|
| 7 |
|
| 8 |
MERaLiON-AudioLLM requires vLLM version `0.6.4.post1` and transformers `4.46.3`
|