base_model: | |
- yamatazen/EtherealAurora-12B | |
- natong19/Mistral-Nemo-Instruct-2407-abliterated | |
library_name: transformers | |
tags: | |
- mergekit | |
- merge | |
- chatml | |
language: | |
- en | |
- ja | |
 | |
This is a ChatML model. | |
# merge | |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). | |
## Merge Details | |
### Merge Method | |
This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method. | |
### Models Merged | |
The following models were included in the merge: | |
* [yamatazen/EtherealAurora-12B](https://huggingface.co/yamatazen/EtherealAurora-12B) | |
* [natong19/Mistral-Nemo-Instruct-2407-abliterated](https://huggingface.co/natong19/Mistral-Nemo-Instruct-2407-abliterated) | |
### Configuration | |
The following YAML configuration was used to produce this model: | |
```yaml | |
base_model: yamatazen/EtherealAurora-12B | |
models: | |
- model: natong19/Mistral-Nemo-Instruct-2407-abliterated | |
merge_method: slerp | |
dtype: bfloat16 | |
parameters: | |
normalize: true | |
t: [0.25,0.3,0.5,0.3,0.25] | |
``` |