---
tags:
- mistral
- mergekit
- merge
---
I just merged two RP models that I thought were good with AlphaMonarch this is nothing special(I don't know what I'm doing), but it is working well for me.

This model is a merge of
[mlabonne/AlphaMonarch-7B](https://huggingface.co/mlabonne/AlphaMonarch-7B) with [Test157t/Kunocchini-7b-128k-test](https://huggingface.co/Test157t/Kunocchini-7b-128k-test)
result merged with [localfultonextractor/Erosumika-7B](https://huggingface.co/localfultonextractor/Erosumika-7B)

ChatML and Alpaca work (Alpaca recommended)

---
base_model:
- localfultonextractor/Erosumika-7B

---
# Erokuna

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the SLERP merge method.

### Models Merged

The following models were included in the merge:
* Merges/Alpha-Kunoccini
* [localfultonextractor/Erosumika-7B](https://huggingface.co/localfultonextractor/Erosumika-7B)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
slices:
  - sources:
      - model: Merges/Alpha-Kunoccini
        layer_range: [0, 32]
      - model: localfultonextractor/Erosumika-7B
        layer_range: [0, 32]
merge_method: slerp
base_model: Merges/Alpha-Kunoccini
parameters:
  t:
    - filter: self_attn
      value: [0, 0.5, 0.3, 0.7, 1]
    - filter: mlp
      value: [1, 0.5, 0.7, 0.3, 0]
    - value: 0.5
dtype: float16

```