🫐🥫 finqa_expert_3b

logo

Model Details

This model is a domain-specific expert model for Moecule family of MoE models.

It is part of Moecule Ingredients and all relevant expert models, LoRA adapters, and datasets can be found there.

Additional Information

  • QLoRA 4-bit fine-tuning with Unsloth
  • Base Model: unsloth/llama-3.2-3b-Instruct

The Team

  • CHOCK Wan Kee
  • Farlin Deva Binusha DEVASUGIN MERLISUGITHA
  • GOH Bao Sheng
  • Jessica LEK Si Jia
  • Sinha KHUSHI
  • TENG Kok Wai (Walter)

References

Downloads last month
10
Safetensors
Model size
3.21B params
Tensor type
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Dataset used to train davzoku/finqa_expert_3b

Collection including davzoku/finqa_expert_3b