File size: 1,059 Bytes
642e0c1
 
 
 
 
 
 
ad63138
ccabfd9
ad63138
ccabfd9
 
 
 
 
ad63138
9e50bca
 
ccabfd9
 
 
ad63138
ccabfd9
ad63138
9e50bca
ad63138
ccabfd9
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
---
license: mit
base_model:
- Qwen/Qwen2.5-7B-Instruct
tags:
- merge
---

# **Qwen2.5-7B-CABS-v0.4: A Merged Model Using a Novel Technique**

This model is a merged version of [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct) utilizing a novel model merging technique to optimize performance while maintaining robustness across tasks.

## **Official Performance**

This model has been officially evaluated on `open_llm_leaderboard`, achieving the following results:

| IFEVAL | BBH  | MATH | GPQA | MUSR | MMLU-PRO | AVG   |
|--------|------|------|------|------|----------|-------|
| 75.83  | 36.36 | 48.39 | 7.72  | 15.17 | 37.73  | 36.88 |

As of **February 19, 2025**, this model ranks **2nd among all 7B and smaller models** on `open_llm_leaderboard`.

For the latest and complete leaderboard rankings, please refer to the [open_llm_leaderboard](https://huggingface.co/spaces/open-llm-leaderboard).

## **Recipe Coming Soon**

We will release details on the merging technique and methodology soon, Stay tuned for updates! 🚀