Qwen
/

Text Generation
Transformers
Safetensors
qwen3_moe
conversational
zhyncs commited on
Commit
61b44ba
·
verified ·
1 Parent(s): 58ccb6e

fix: use tp 4 for SGLang

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -95,7 +95,7 @@ print("content:", content)
95
  For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.4` or to create an OpenAI-compatible API endpoint:
96
  - SGLang:
97
  ```shell
98
- python -m sglang.launch_server --model-path Qwen/Qwen3-235B-A22B --reasoning-parser qwen3
99
  ```
100
  - vLLM:
101
  ```shell
 
95
  For deployment, you can use `sglang>=0.4.6.post1` or `vllm>=0.8.4` or to create an OpenAI-compatible API endpoint:
96
  - SGLang:
97
  ```shell
98
+ python -m sglang.launch_server --model-path Qwen/Qwen3-235B-A22B --reasoning-parser qwen3 --tp 4
99
  ```
100
  - vLLM:
101
  ```shell