--- base_model: - cgato/Nemo-12b-Humanize-KTO-Experimental-Latest - DoppelReflEx/MN-12B-Mimicore-GreenSnake - MarinaraSpaghetti/NemoMix-Unleashed-12B - IntervitensInc/Mistral-Nemo-Base-2407-chatml library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [DARE TIES](https://arxiv.org/abs/2311.03099) merge method using [IntervitensInc/Mistral-Nemo-Base-2407-chatml](https://huggingface.co/IntervitensInc/Mistral-Nemo-Base-2407-chatml) as a base. ### Models Merged The following models were included in the merge: * [cgato/Nemo-12b-Humanize-KTO-Experimental-Latest](https://huggingface.co/cgato/Nemo-12b-Humanize-KTO-Experimental-Latest) * [DoppelReflEx/MN-12B-Mimicore-GreenSnake](https://huggingface.co/DoppelReflEx/MN-12B-Mimicore-GreenSnake) * [MarinaraSpaghetti/NemoMix-Unleashed-12B](https://huggingface.co/MarinaraSpaghetti/NemoMix-Unleashed-12B) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: cgato/Nemo-12b-Humanize-KTO-Experimental-Latest parameters: density: 0.9 weight: 1 - model: DoppelReflEx/MN-12B-Mimicore-GreenSnake parameters: density: 0.5 weight: 0.7 - model: MarinaraSpaghetti/NemoMix-Unleashed-12B parameters: density: 0.7 weight: 0.5 merge_method: dare_ties base_model: IntervitensInc/Mistral-Nemo-Base-2407-chatml tokenizer_source: base ```