Share Your Attention: Transformer Weight Sharing via Matrix-based Dictionary Learning
Paper
•
2508.04581
•
Published
•
5
Ammar Ali
ammarali32
AI & ML interests
PhD student at ITMO University and senior researcher at MTS AI.
Kaggle competitions Master
Ranked Top-1 on dsworks platform.
Winner first place of 7 ML competitions on different fields.
Recent Activity
liked
a dataset
10 days ago
MTSAIR/MWS-Vision-Bench
authored
a paper
about 1 month ago
Share Your Attention: Transformer Weight Sharing via Matrix-based
Dictionary Learning
authored
a paper
about 1 month ago
COSPADI: Compressing LLMs via Calibration-Guided Sparse Dictionary
Learning
Organizations
authored
2
papers
about 1 month ago
authored
a
paper
6 months ago