gz987's picture
Update README.md
ad0a057 verified
metadata
license: mit
base_model:
  - Qwen/Qwen2.5-7B-Instruct
tags:
  - merge

Qwen2.5-7B-CABS-v0.3: A Merged Model Using a Novel Technique

This model is a merged version of Qwen/Qwen2.5-7B-Instruct utilizing a novel model merging technique to optimize performance while maintaining robustness across tasks.

Official Performance

This model has been officially evaluated on open_llm_leaderboard, achieving the following results:

IFEVAL BBH MATH GPQA MUSR MMLU-PRO AVG
75.70 35.96 49.32 7.61 15.24 37.80 36.94

As of February 19, 2025, this model ranks 1st among all 7B and smaller models on open_llm_leaderboard.

For the latest and complete leaderboard rankings, please refer to the open_llm_leaderboard.

Recipe Coming Soon

We will release details on the merging technique and methodology soon, Stay tuned for updates! 🚀