qingy2024/Qwen2.5-Math-14B-Instruct-Pro

---

base_model:

• Qwen/Qwen2.5-14B

• Qwen/Qwen2.5-14B-Instruct

• qingy2019/Qwen2.5-Math-14B-Instruct-Alpha

library_name: transformers

tags:

• mergekit

• merge

language:

• zho

• eng

• fra

• spa

• por

• deu

• ita

• rus

• jpn

• kor

• vie

• tha

• ara

---

merge

This is a merge of pre-trained language models created using mergekit

Merge Details

Merge Method

This model was merged using the TIES merge method using Qwen/Qwen2.5-14B as a base.

Models Merged

The following models were included in the merge:

• Qwen/Qwen2.5-14B-Instruct

• qingy2019/Qwen2.5-Math-14B-Instruct-Alpha

Configuration

The following YAML configuration was used to produce this model:

 models:

   - model: qingy2019/Qwen2.5-Math-14B-Instruct-Alpha

     parameters:

       weight: 1

       density: 1

   - model: Qwen/Qwen2.5-14B-Instruct

     parameters:

       weight: 1

       density: 1

 merge_method: ties

 base_model: Qwen/Qwen2.5-14B

 parameters:

   weight: 1

   density: 1

   normalize: true

   int8_mask: true

 tokenizer_source: qingy2019/Qwen2.5-Math-14B-Instruct-Alpha

 dtype: bfloat16