File size: 1,059 Bytes
642e0c1 ad63138 ccabfd9 ad63138 ccabfd9 ad63138 9e50bca ccabfd9 ad63138 ccabfd9 ad63138 9e50bca ad63138 ccabfd9 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 |
---
license: mit
base_model:
- Qwen/Qwen2.5-7B-Instruct
tags:
- merge
---
# **Qwen2.5-7B-CABS-v0.4: A Merged Model Using a Novel Technique**
This model is a merged version of [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct) utilizing a novel model merging technique to optimize performance while maintaining robustness across tasks.
## **Official Performance**
This model has been officially evaluated on `open_llm_leaderboard`, achieving the following results:
| IFEVAL | BBH | MATH | GPQA | MUSR | MMLU-PRO | AVG |
|--------|------|------|------|------|----------|-------|
| 75.83 | 36.36 | 48.39 | 7.72 | 15.17 | 37.73 | 36.88 |
As of **February 19, 2025**, this model ranks **2nd among all 7B and smaller models** on `open_llm_leaderboard`.
For the latest and complete leaderboard rankings, please refer to the [open_llm_leaderboard](https://huggingface.co/spaces/open-llm-leaderboard).
## **Recipe Coming Soon**
We will release details on the merging technique and methodology soon, Stay tuned for updates! 🚀
|