File size: 1,659 Bytes
3ab4570 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 |
---
base_model:
- bunnycore/Llama-3.1-8B-TitanFusion-Mix
- djuna/L3.1-Promissum_Mane-8B-Della-calc
- DreadPoor/ONeil-model_stock-8B
- jaspionjader/Kosmos-EVAA-v9-TitanFusion-Mix-8B
- DreadPoor/Aurora_faustus-8B-LINEAR
- jaspionjader/kstc-5-8b
library_name: transformers
tags:
- mergekit
- merge
---
# merge
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
## Merge Details
### Merge Method
This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [jaspionjader/kstc-5-8b](https://huggingface.co/jaspionjader/kstc-5-8b) as a base.
### Models Merged
The following models were included in the merge:
* [bunnycore/Llama-3.1-8B-TitanFusion-Mix](https://huggingface.co/bunnycore/Llama-3.1-8B-TitanFusion-Mix)
* [djuna/L3.1-Promissum_Mane-8B-Della-calc](https://huggingface.co/djuna/L3.1-Promissum_Mane-8B-Della-calc)
* [DreadPoor/ONeil-model_stock-8B](https://huggingface.co/DreadPoor/ONeil-model_stock-8B)
* [jaspionjader/Kosmos-EVAA-v9-TitanFusion-Mix-8B](https://huggingface.co/jaspionjader/Kosmos-EVAA-v9-TitanFusion-Mix-8B)
* [DreadPoor/Aurora_faustus-8B-LINEAR](https://huggingface.co/DreadPoor/Aurora_faustus-8B-LINEAR)
### Configuration
The following YAML configuration was used to produce this model:
```yaml
models:
- model: bunnycore/Llama-3.1-8B-TitanFusion-Mix
- model: DreadPoor/ONeil-model_stock-8B
- model: DreadPoor/Aurora_faustus-8B-LINEAR
- model: jaspionjader/Kosmos-EVAA-v9-TitanFusion-Mix-8B
- model: djuna/L3.1-Promissum_Mane-8B-Della-calc
merge_method: model_stock
base_model: jaspionjader/kstc-5-8b
dtype: bfloat16
```
|