Avinash Sooriyarachchi's picture

2 1 82

Avinash Sooriyarachchi

AviSoori1x

·

https://www.linkedin.com/in/avi-data-ml/

AI & ML interests

I work at Mistral AI

Articles

seemore: Implement a Vision Language Model from Scratch

SeeMoE: Implementing a MoE Vision Language Model from Scratch

makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch

Sparse Mixture of Experts Language Model from Scratch: Extending makeMoE with Expert Capacity

Organizations

AviSoori1x's activity

upvoted a paper 8 months ago

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

Paper • 2403.03507 • Published Mar 6 • 182