moecule-3x3b-m5 / README.md

davzoku

Update README.md

a05e6b8 verified 7 days ago

preview code

raw

history blame contribute delete

283 Bytes

python -m moetify.mix \
   --output_dir ./moecule-3x3b-m5 \
   --model_path  unsloth/Llama-3.2-3B-Instruct \
   --modules mlp q_proj \
   --ingredients \
       unsloth/Llama-3.2-3B-Instruct \
       unsloth/Llama-3.2-3B-Instruct \
       unsloth/Llama-3.2-3B-Instruct