--- license: apache-2.0 tags: - merge - mergekit - lazymergekit - mistralai/Mistral-7B-Instruct-v0.2 - meta-math/MetaMath-Mistral-7B - openchat/openchat-3.5-1210 --- # 3-merges-Ties-Mistral 3-merges-Ties-Mistral is a merge of the following models using [mergekit](https://github.com/cg123/mergekit): * [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) * [meta-math/MetaMath-Mistral-7B](https://huggingface.co/meta-math/MetaMath-Mistral-7B) * [openchat/openchat-3.5-1210](https://huggingface.co/openchat/openchat-3.5-1210) ## 🧩 Configuration ```yaml models: - model: mistralai/Mistral-7B-v0.1 # No parameters — acts as base_model - model: mistralai/Mistral-7B-Instruct-v0.2 parameters: density: 0.5 weight: 0.25 - model: meta-math/MetaMath-Mistral-7B parameters: density: 0.5 weight: 0.25 - model: openchat/openchat-3.5-1210 parameters: density: 0.5 weight: 0.25 merge_method: ties base_model: mistralai/Mistral-7B-v0.1 parameters: normalize: true dtype: float16 ```