When trying to load the model bullerwins_Qwen3-30B-A3B-awq using vllm:v0.8.5, I encountered a failure with the following error:
KeyError: 'layers.0.mlp.gate.qweight'
However, loading bullerwins_Qwen3-32B-awq works fine without any issues.
· Sign up or log in to comment