Failed to Load bullerwins_Qwen3-30B-A3B-awq with vllm:v0.8.5

#1
by Tianh - opened

When trying to load the model bullerwins_Qwen3-30B-A3B-awq using vllm:v0.8.5, I encountered a failure with the following error:

KeyError: 'layers.0.mlp.gate.qweight'

However, loading bullerwins_Qwen3-32B-awq works fine without any issues.

Sign up or log in to comment