Harbous/SmolLM2-360-finetuned-sql-instruct
Updated
β’
1
Oussema Harbi
Harbous
DualityAI-RebekahBogdanoff's profile picture
Mi6paulino's profile picture
Juanelopo's profile picture
Β·
AI & ML interests
None yet
Recent Activity
liked
a model
13 days ago
XiaomiMiMo/MiMo-7B-RL
reacted
to
ImranzamanML's
post
with π
17 days ago
π New paper out: "Improving Arabic Multi-Label Emotion Classification using Stacked Embeddings and Hybrid Loss Function"
https://huggingface.co/papers/2410.03979
In this work, we tackle some major challenges in Arabic multi-label emotion classification especially the issues of class imbalance and label correlation that often hurt model performance, particularly for minority emotions.
Our approach:
Stacked contextual embeddings from fine-tuned ArabicBERT, MarBERT, and AraBERT models.
A meta-learning strategy that builds richer representations.
A hybrid loss function combining class weighting, label correlation matrices, and contrastive learning to better handle class imbalances.
π§ Model pipeline: stacked embeddings β meta-learner β Bi-LSTM β fully connected network β multi-label classification.
π Extensive experiments show significant improvements across Precision, Recall, F1-Score, Jaccard Accuracy, and Hamming Loss.
π The hybrid loss function in particular helped close the gap between majority and minority classes!
We also performed ablation studies to break down each componentβs contribution and the results consistently validated our design choices.
This framework isn't just for Arabic it offers a generalizable path for improving multi-label emotion classification in other low-resource languages and domains.
Big thanks to my co-authors: Muhammad Azeem Aslam, Wang Jun, Nisar Ahmed, Li Yanan, Hu Hongfei, Wang Shiyu, and Xin Liu!
Would love to hear your thoughts on this work! π
Organizations
None yet
models
1
datasets
0
None public yet