--- base_model: - gz987/qwen2.5-7b-cabs-v0.4 - suayptalha/Clarus-7B-v0.2 - Orion-zhen/Qwen2.5-7B-Instruct-Uncensored - suayptalha/Clarus-7B-v0.1 - prithivMLmods/QwQ-MathOct-7B - Qwen/Qwen2.5-7B-Instruct - gz987/qwen2.5-7b-cabs-v0.3 - Xiaojian9992024/Qwen2.5-Dyanka-7B-Preview - prithivMLmods/QwQ-LCoT-7B-Instruct - prithivMLmods/Deepthink-Reasoning-7B library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct) as a base. ### Models Merged The following models were included in the merge: * [gz987/qwen2.5-7b-cabs-v0.4](https://huggingface.co/gz987/qwen2.5-7b-cabs-v0.4) * [suayptalha/Clarus-7B-v0.2](https://huggingface.co/suayptalha/Clarus-7B-v0.2) * [Orion-zhen/Qwen2.5-7B-Instruct-Uncensored](https://huggingface.co/Orion-zhen/Qwen2.5-7B-Instruct-Uncensored) * [suayptalha/Clarus-7B-v0.1](https://huggingface.co/suayptalha/Clarus-7B-v0.1) * [prithivMLmods/QwQ-MathOct-7B](https://huggingface.co/prithivMLmods/QwQ-MathOct-7B) * [gz987/qwen2.5-7b-cabs-v0.3](https://huggingface.co/gz987/qwen2.5-7b-cabs-v0.3) * [Xiaojian9992024/Qwen2.5-Dyanka-7B-Preview](https://huggingface.co/Xiaojian9992024/Qwen2.5-Dyanka-7B-Preview) * [prithivMLmods/QwQ-LCoT-7B-Instruct](https://huggingface.co/prithivMLmods/QwQ-LCoT-7B-Instruct) * [prithivMLmods/Deepthink-Reasoning-7B](https://huggingface.co/prithivMLmods/Deepthink-Reasoning-7B) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: Xiaojian9992024/Qwen2.5-Dyanka-7B-Preview - model: gz987/qwen2.5-7b-cabs-v0.3 - model: gz987/qwen2.5-7b-cabs-v0.4 - model: Orion-zhen/Qwen2.5-7B-Instruct-Uncensored - model: prithivMLmods/Deepthink-Reasoning-7B - model: prithivMLmods/QwQ-LCoT-7B-Instruct - model: prithivMLmods/QwQ-MathOct-7B - model: suayptalha/Clarus-7B-v0.2 - model: suayptalha/Clarus-7B-v0.1 merge_method: model_stock base_model: Qwen/Qwen2.5-7B-Instruct normalize: false int8_mask: true dtype: bfloat16 ```