Upload README.md

README.md

@@ -1,40 +1,15 @@
----
-base_model: []
-library_name: transformers
-tags:
-- mergekit
-- merge
+This model is a merged model based on [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct) using a novel model merging technique.
 
----
-# Untitled Model (1)
+## **Performance (Self-Tested on A100)**
 
-This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+The following results are obtained using **batch_size=6** on an A100 GPU. Official results are pending submission to `open_llm_leaderboard`.
 
-## Merge Details
-### Merge Method
+| IFEVAL | BBH  | MATH | GPQA | MUSR | MMLU-PRO | AVG   |
+|--------|------|------|------|------|----------|-------|
+| 75.21  | 36.03 | 48.87 | 7.61  | 15.37 | 37.8     | 36.815 |
 
-This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using /home/LAB/yangzz/rank/Qwen2.5-7B-Instrust/ as a base.
+**Note**: These results will be updated once officially verified.
 
-### Models Merged
+## **Recipe Coming Soon**
 
-The following models were included in the merge:
-* /home/LAB/yangzz/rank/Tsunami-0.5-7B-Instruct-model-nm-32-128-fq-first/
-* /home/LAB/yangzz/rank/fq2.5-7b-it-normalize_true-model-nm-32-128-fq-first/
-
-### Configuration
-
-The following YAML configuration was used to produce this model:
-
-```yaml
-models:
-  - model: /home/LAB/yangzz/rank/Tsunami-0.5-7B-Instruct-model-nm-32-128-fq-first/
-    parameters:
-      weight: 0.55
-  - model: /home/LAB/yangzz/rank/fq2.5-7b-it-normalize_true-model-nm-32-128-fq-first/
-    parameters:
-      weight: 0.5
-         
-merge_method: task_arithmetic
-dtype: bfloat16
-base_model:  /home/LAB/yangzz/rank/Qwen2.5-7B-Instrust/
-```
+We will release details on the merging technique and methodology soon. Stay tuned! 🚀