Upload folder using huggingface_hub
Browse files
README.md
CHANGED
@@ -169,7 +169,7 @@ print("content:", content)
|
|
169 |
For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.5` or to create an OpenAI-compatible API endpoint:
|
170 |
- SGLang:
|
171 |
```shell
|
172 |
-
python -m sglang.launch_server --model-path Qwen/Qwen3-235B-A22B-Thinking-2507 --tp 8 --context-length 262144 --reasoning-parser
|
173 |
```
|
174 |
- vLLM:
|
175 |
```shell
|
|
|
169 |
For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.5` or to create an OpenAI-compatible API endpoint:
|
170 |
- SGLang:
|
171 |
```shell
|
172 |
+
python -m sglang.launch_server --model-path Qwen/Qwen3-235B-A22B-Thinking-2507 --tp 8 --context-length 262144 --reasoning-parser deepseek-r1
|
173 |
```
|
174 |
- vLLM:
|
175 |
```shell
|