🫐🥫 finqa_expert_1b

logo

Model Details

This model is a domain-specific expert model for Moecule family of MoE models.

It is part of Moecule Ingredients and all relevant expert models, LoRA adapters, and datasets can be found there.

Additional Information

  • QLoRA 4-bit fine-tuning with Unsloth
  • Base Model: unsloth/llama-3.2-1b-Instruct

The Team

  • CHOCK Wan Kee
  • Farlin Deva Binusha DEVASUGIN MERLISUGITHA
  • GOH Bao Sheng
  • Jessica LEK Si Jia
  • Sinha KHUSHI
  • TENG Kok Wai (Walter)

References

Downloads last month
9
Safetensors
Model size
1.24B params
Tensor type
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Dataset used to train davzoku/finqa_expert_1b

Collection including davzoku/finqa_expert_1b