experimental_merge / README.md
Pedro13543's picture
Upload folder using huggingface_hub
1c043e1 verified
---
base_model:
- Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
- Skywork/Skywork-o1-Open-Llama-3.1-8B
- TheDrummer/Llama-3SOME-8B-v2
- Sao10K/Llama-3.1-8B-Stheno-v3.4
- deepseek-ai/DeepSeek-R1-Distill-Llama-8B
- Sao10K/L3-8B-Niitama-v1
- Undi95/Llama3-Unholy-8B-OAS
- mergekit-community/hopefully_humanish-rp-nsfw-test-v-retry
- SicariusSicariiStuff/Impish_Mind_8B
- Undi95/Meta-Llama-3.1-8B-Claude
- ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.3
- bluuwhale/L3-SthenoMaidBlackroot-8B-V1
- Solshine/reflection-llama-3.1-8B-Solshine-Full
- Nitral-AI/Poppy_Porpoise-0.72-L3-8B
- vicgalle/Humanish-Roleplay-Llama-3.1-8B
- vicgalle/Roleplay-Hermes-3-Llama-3.1-8B
library_name: transformers
tags:
- mergekit
- merge
---
# merge
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
## Merge Details
### Merge Method
This model was merged using the [SCE](https://arxiv.org/abs/2408.07990) merge method using [vicgalle/Humanish-Roleplay-Llama-3.1-8B](https://huggingface.co/vicgalle/Humanish-Roleplay-Llama-3.1-8B) as a base.
### Models Merged
The following models were included in the merge:
* [Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2](https://huggingface.co/Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2)
* [Skywork/Skywork-o1-Open-Llama-3.1-8B](https://huggingface.co/Skywork/Skywork-o1-Open-Llama-3.1-8B)
* [TheDrummer/Llama-3SOME-8B-v2](https://huggingface.co/TheDrummer/Llama-3SOME-8B-v2)
* [Sao10K/Llama-3.1-8B-Stheno-v3.4](https://huggingface.co/Sao10K/Llama-3.1-8B-Stheno-v3.4)
* [deepseek-ai/DeepSeek-R1-Distill-Llama-8B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B)
* [Sao10K/L3-8B-Niitama-v1](https://huggingface.co/Sao10K/L3-8B-Niitama-v1)
* [Undi95/Llama3-Unholy-8B-OAS](https://huggingface.co/Undi95/Llama3-Unholy-8B-OAS)
* [mergekit-community/hopefully_humanish-rp-nsfw-test-v-retry](https://huggingface.co/mergekit-community/hopefully_humanish-rp-nsfw-test-v-retry)
* [SicariusSicariiStuff/Impish_Mind_8B](https://huggingface.co/SicariusSicariiStuff/Impish_Mind_8B)
* [Undi95/Meta-Llama-3.1-8B-Claude](https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude)
* [ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.3](https://huggingface.co/ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.3)
* [bluuwhale/L3-SthenoMaidBlackroot-8B-V1](https://huggingface.co/bluuwhale/L3-SthenoMaidBlackroot-8B-V1)
* [Solshine/reflection-llama-3.1-8B-Solshine-Full](https://huggingface.co/Solshine/reflection-llama-3.1-8B-Solshine-Full)
* [Nitral-AI/Poppy_Porpoise-0.72-L3-8B](https://huggingface.co/Nitral-AI/Poppy_Porpoise-0.72-L3-8B)
* [vicgalle/Roleplay-Hermes-3-Llama-3.1-8B](https://huggingface.co/vicgalle/Roleplay-Hermes-3-Llama-3.1-8B)
### Configuration
The following YAML configuration was used to produce this model:
```yaml
models:
# Pivot model
- model: deepseek-ai/DeepSeek-R1-Distill-Llama-8B
# Target models
- model: ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.3
- model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
- model: Undi95/Llama3-Unholy-8B-OAS
- model : Undi95/Meta-Llama-3.1-8B-Claude
- model : vicgalle/Humanish-Roleplay-Llama-3.1-8B
- model: vicgalle/Roleplay-Hermes-3-Llama-3.1-8B
- model: TheDrummer/Llama-3SOME-8B-v2
- model: Skywork/Skywork-o1-Open-Llama-3.1-8B
- model: Solshine/reflection-llama-3.1-8B-Solshine-Full
- model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
- model : Sao10K/Llama-3.1-8B-Stheno-v3.4
- model: Nitral-AI/Poppy_Porpoise-0.72-L3-8B
- model: mergekit-community/hopefully_humanish-rp-nsfw-test-v-retry
- model: Sao10K/L3-8B-Niitama-v1
- model: SicariusSicariiStuff/Impish_Mind_8B
merge_method: sce
base_model: vicgalle/Humanish-Roleplay-Llama-3.1-8B
parameters:
select_topk: 1.0
dtype: bfloat16
```