BabyLM Sequence Length

community

AI & ML interests

BabyLM 2025 paper submission

Recent Activity

rdiehlmartinez updated a model about 4 hours ago

babylm-seqlen/opt-4096-warmup-test

rdiehlmartinez published a model 1 day ago

babylm-seqlen/opt-4096-warmup-test

codebyzeb updated a model 3 days ago

babylm-seqlen/opt-64

View all activity

Collections 2

models 35

babylm-seqlen/opt-4096-warmup-test

Text Generation • Updated about 4 hours ago • 4

babylm-seqlen/mamba-4096

Updated 4 days ago • 237

babylm-seqlen/opt-8192

Updated 4 days ago • 324

babylm-seqlen/opt-4096

Updated 4 days ago • 208

babylm-seqlen/mamba-8192

Updated 7 days ago • 257

babylm-seqlen/mamba-8192-warmup

Updated 7 days ago • 147

babylm-seqlen/mamba-4096-warmup

Updated 7 days ago • 122

babylm-seqlen/mamba-2048-warmup

Updated 7 days ago • 20

babylm-seqlen/mamba-512-warmup

Updated 7 days ago • 18

babylm-seqlen/mamba-1024-warmup

Updated 7 days ago • 32

datasets 18

babylm-seqlen/train_100M_64

Viewer • Updated Apr 8 • 2.56M • 13

babylm-seqlen/train_100M_512_single_shuffle

Viewer • Updated Apr 8 • 319k • 17

babylm-seqlen/train_100M_8192_single_shuffle

Viewer • Updated Apr 8 • 19.8k • 18

babylm-seqlen/train_100M_2048_single_shuffle

Viewer • Updated Apr 8 • 79.8k • 17

babylm-seqlen/train_100M_16384_single_shuffle

Viewer • Updated Apr 8 • 9.86k • 11

babylm-seqlen/train_100M_4096_single_shuffle

Viewer • Updated Apr 8 • 39.8k • 23

babylm-seqlen/train_100M_256_single_shuffle

Viewer • Updated Apr 8 • 639k • 20

babylm-seqlen/train_100M_1024_single_shuffle

Viewer • Updated Apr 8 • 160k • 20

babylm-seqlen/train_100M_128_single_shuffle

Viewer • Updated Apr 8 • 1.28M • 21

babylm-seqlen/train_100M_64_single_shuffle

Viewer • Updated Apr 8 • 2.56M • 26