moecule-3x1b-m4 / README.md

davzoku

Create README.md

9883090 verified 7 days ago

preview code

raw

history blame contribute delete

282 Bytes

python -m moetify.mix \
   --output_dir ./moecule-3x1b-m4 \
   --model_path  unsloth/Llama-3.2-1B-Instruct \
   --modules mlp q_proj \
   --ingredients \
       unsloth/Llama-3.2-1B-Instruct \
       unsloth/Llama-3.2-1B-Instruct \
       unsloth/Llama-3.2-1B-Instruct