L3-SaoMerge-Della-v1 / .ipynb_checkpoints /mergekit_config-checkpoint.yml
jsfs11's picture
Upload folder using huggingface_hub
ab82b11 verified
raw
history blame contribute delete
415 Bytes
models:
- model: Sao10K/L3-8B-Lunaris-v1
parameters:
weight: .35
- model: Sao10K/L3-8B-Stheno-v3.2
parameters:
weight: .2
- model: Sao10K/L3-8B-Niitama-v1
parameters:
weight: .25
- model: Sao10K/L3-8B-Tamamo-v1
parameters:
weight: .2
base_model: Sao10K/L3-8B-Stheno-v3.2
merge_method: della
parameters:
density: 0.5
epsilon: 0.1
lambda: 1.0
dtype: bfloat16