400 error with qwen-code
#2
by
darkstar3537
- opened
Getting a ✕ [API Error: OpenAI API error: 400 status code (no body)] when trying to use this model with qwen-code (built from latest commit) hosted on vllm. Any ideas?
It works! you need to set --enable-auto-tool-choice and --tool-call-parser qwen3_coder. Just be sure to follow this:
https://docs.vllm.ai/projects/recipes/en/latest/Qwen/Qwen3-Coder-480B-A35B.html#launching-qwen3-coder-with-vllm