--- base_model: - huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 - Cran-May/T.E-8.1 - Qwen/Qwen2.5-7B-Instruct - deepseek-ai/DeepSeek-R1-Distill-Qwen-7B - marcuscedricridia/Yell-Qwen2.5-7B-Coder library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct) as a base. ### Models Merged The following models were included in the merge: * [huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2](https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2) * [Cran-May/T.E-8.1](https://huggingface.co/Cran-May/T.E-8.1) * [deepseek-ai/DeepSeek-R1-Distill-Qwen-7B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B) * [marcuscedricridia/Yell-Qwen2.5-7B-Coder](https://huggingface.co/marcuscedricridia/Yell-Qwen2.5-7B-Coder) ### Configuration The following YAML configuration was used to produce this model: ```yaml merge_method: model_stock base_model: Qwen/Qwen2.5-7B-Instruct models: - model: marcuscedricridia/Yell-Qwen2.5-7B-Coder - model: Cran-May/T.E-8.1 - model: deepseek-ai/DeepSeek-R1-Distill-Qwen-7B - model: huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 dtype: bfloat16 tokenizer_source: base int8_mask: true normalize: true name: Yell-Qwen2.5-7B-Stock ```