Mohammed Khalil's picture

Mohammed Khalil

mohamed-khalil

·

https://v3xlrm1nOwo1.github.io

AI & ML interests

ML Researcher || NLP || anime

Recent Activity

reacted to Jaward's post with ❤️ 6 days ago

nanoBLT: Simplified lightweight implementation of a character-level Byte Latent Transformer model (under 500 lines of code). The model is 2x4x2 (n_layers_encoder, n_layers_latent, n_layers_decoder) layer deep trained on ~1M bytes of tiny Shakespeare with a patch size of 4. Code: https://github.com/Jaykef/ai-algorithms/blob/main/byte_latent_transformer.ipynb

upvoted a paper about 2 months ago

Large Language Diffusion Models

liked a dataset about 2 months ago

brando/small-c4-dataset

View all activity

Organizations

mohamed-khalil 's models

None public yet