Hugging Face's logo

davzoku
/
moecule-3x1b-m4

Safetensors
moellama
custom_code
Model card Files Community
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)
python -m moetify.mix \
   --output_dir ./moecule-3x1b-m4 \
   --model_path  unsloth/Llama-3.2-1B-Instruct \
   --modules mlp q_proj \
   --ingredients \
       unsloth/Llama-3.2-1B-Instruct \
       unsloth/Llama-3.2-1B-Instruct \
       unsloth/Llama-3.2-1B-Instruct
Downloads last month
3
Safetensors
Model size
3.24B params
Tensor type
BF16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Collection including davzoku/moecule-3x1b-m4