Llama-3.2-4X3B-MOE-Hell-California-10B / mergekit_moe_config.yml
DavidAU's picture
Upload folder using huggingface_hub
f7745bd verified
raw
history blame
336 Bytes
base_model: G:/3B/Llama-3.2-3B-Instruct-abliterated
gate_mode: random
dtype: bfloat16
experts_per_token: 2
experts:
- source_model: G:/3B/L3.2-JametMini-3B-MK.I
- source_model: G:/3B/L3.2-JametMini-3B-MK.III
- source_model: G:/3B/Llama-3.2-3B-Instruct-abliterated
- source_model: G:/3B/Llama-3.2-3B-Instruct-uncensored