|
|
--- |
|
|
base_model: |
|
|
- Isotonic/OrcaAgent-llama3.2-1b |
|
|
- Novaciano/SENTIMENTAL_SEX-3.2-1B |
|
|
- Novaciano/Llama-3.2-1B-Carpincho_Alzado |
|
|
datasets: |
|
|
- microsoft/orca-agentinstruct-1M-v1 |
|
|
- Isotonic/agentinstruct-1Mv1-combined |
|
|
- trl-lib/Capybara |
|
|
- HuggingFaceTB/smoltalk |
|
|
- Guilherme34/uncensor |
|
|
- teknium/OpenHermes-2.5 |
|
|
- passing2961/multifaceted-skill-of-mind |
|
|
- PawanKrd/math-gpt-4o-200k |
|
|
- V3N0M/Jenna-50K-Alpaca-Uncensored |
|
|
- cognitivecomputations/dolphin-coder |
|
|
- mlabonne/FineTome-100k |
|
|
- microsoft/orca-math-word-problems-200k |
|
|
- CarrotAI/ko-instruction-dataset |
|
|
- Salesforce/xlam-function-calling-60k |
|
|
- anthracite-org/kalo-opus-instruct-22k-no-refusal |
|
|
- anthracite-org/stheno-filtered-v1.1 |
|
|
- anthracite-org/nopm_claude_writing_fixed |
|
|
- AiAF/SCPWiki-Archive-02-March-2025-Datasets |
|
|
- huihui-ai/QWQ-LONGCOT-500K |
|
|
- huihui-ai/LONGCOT-Refine-500K |
|
|
- Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned |
|
|
- Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned |
|
|
- alexandreteles/AlpacaToxicQA_ShareGPT |
|
|
- Nitral-AI/Active_RP-ShareGPT |
|
|
- PJMixers/hieunguyenminh_roleplay-deduped-ShareGPT |
|
|
- Nitral-AI/RP_Alignment-ShareGPT |
|
|
- Chaser-cz/sonnet35-charcard-roleplay-sharegpt |
|
|
- AiCloser/sharegpt_cot_dataset |
|
|
- PJMixers/Gryphe_Opus-WritingPrompts-Story2Prompt-ShareGPT |
|
|
- priveeai/pippa_sharegpt |
|
|
- Locutusque/sharegpt_gpt4_uncensored_cleaned |
|
|
- OpenCoder-LLM/opc-sft-stage1 |
|
|
- OpenCoder-LLM/opc-sft-stage2 |
|
|
- microsoft/orca-agentinstruct-1M-v1 |
|
|
- NousResearch/hermes-function-calling-v1 |
|
|
- AI-MO/NuminaMath-CoT |
|
|
- AI-MO/NuminaMath-TIR |
|
|
- allenai/tulu-3-sft-mixture |
|
|
- cognitivecomputations/samantha-data |
|
|
- m-a-p/CodeFeedback-Filtered-Instruction |
|
|
- m-a-p/Code-Feedback |
|
|
- FreedomIntelligence/medical-o1-reasoning-SFT |
|
|
library_name: transformers |
|
|
tags: |
|
|
- mergekit |
|
|
- merge |
|
|
license: llama3.2 |
|
|
language: |
|
|
- es |
|
|
- en |
|
|
--- |
|
|
# merge |
|
|
|
|
|
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). |
|
|
|
|
|
## Merge Details |
|
|
### Merge Method |
|
|
|
|
|
This model was merged using the [SCE](https://arxiv.org/abs/2408.07990) merge method using [Novaciano/SENTIMENTAL_SEX-3.2-1B](https://huggingface.co/Novaciano/SENTIMENTAL_SEX-3.2-1B) as a base. |
|
|
|
|
|
### Models Merged |
|
|
|
|
|
The following models were included in the merge: |
|
|
* [Isotonic/OrcaAgent-llama3.2-1b](https://huggingface.co/Isotonic/OrcaAgent-llama3.2-1b) |
|
|
* [Novaciano/Llama-3.2-1B-Carpincho_Alzado](https://huggingface.co/Novaciano/Llama-3.2-1B-Carpincho_Alzado) |
|
|
|
|
|
### Configuration |
|
|
|
|
|
The following YAML configuration was used to produce this model: |
|
|
|
|
|
```yaml |
|
|
merge_method: sce |
|
|
models: |
|
|
- model: Isotonic/OrcaAgent-llama3.2-1b |
|
|
- model: Novaciano/SENTIMENTAL_SEX-3.2-1B |
|
|
- model: Novaciano/Llama-3.2-1B-Carpincho_Alzado |
|
|
base_model: Novaciano/SENTIMENTAL_SEX-3.2-1B |
|
|
dtype: bfloat16 |
|
|
out_dtype: bfloat16 |
|
|
parameters: |
|
|
int8_mask: true |
|
|
normalize: true |
|
|
rescale: false |
|
|
chat_template: auto |
|
|
tokenizer: |
|
|
source: union |
|
|
``` |
