Article
makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch
By
•
•
84MD Khairul Islam
khairulislam
·
AI & ML interests
Time series, NLP, and XAI
Recent Activity
upvoted
an
article
8 days ago
makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch
upvoted
an
article
17 days ago
Perceiver IO: a scalable, fully-attentional model that works on any modality
liked
a Space
4 months ago
nanotron/ultrascale-playbook
Organizations
None yet
khairulislam's activity
upvoted
an
article
8 days ago
upvoted
an
article
17 days ago
Article
Perceiver IO: a scalable, fully-attentional model that works on any modality
By
•
•
9