fix: use tp 4 for SGLang
Browse files
README.md
CHANGED
@@ -95,7 +95,7 @@ print("content:", content)
|
|
95 |
For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.4` or to create an OpenAI-compatible API endpoint:
|
96 |
- SGLang:
|
97 |
```shell
|
98 |
-
python -m sglang.launch_server --model-path Qwen/Qwen3-235B-A22B --reasoning-parser qwen3
|
99 |
```
|
100 |
- vLLM:
|
101 |
```shell
|
|
|
95 |
For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.4` or to create an OpenAI-compatible API endpoint:
|
96 |
- SGLang:
|
97 |
```shell
|
98 |
+
python -m sglang.launch_server --model-path Qwen/Qwen3-235B-A22B --reasoning-parser qwen3 --tp 4
|
99 |
```
|
100 |
- vLLM:
|
101 |
```shell
|