---
license: apache-2.0
---
```python
# To use the model
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("Shengkun/Qwen3-16B-A2B-Pruned")
```

**16B**

| Model            | Method                  | Param. | SciQ | PIQA | WG   | ArcE | ArcC | HS   | LogiQA | BoolQ | MMLU | Avg  |
|-----------------|------------------------|--------|------|------|------|------|------|------|--------|-------|------|------|
| **Qwen3-30B-A3B** | **Dense**               | 30B A3B     | 97.0 | 79.7 | 71.5 | 79.7 | 68.8 | 77.8 | 34.7   | 88.8  | 79.6 | 75.2 |
|                 | **Uniform**             | 16B A2B   | 94.9 | 71.4 | 60.2 | 73.2 | 52.6 | 47.0 | 33.2   | 75.0  | 55.6 | 62.5 |