ThomasTheMaker/pico-decoder-tiny-experiments
Updated
Pico LM
Pre-training 11M parameter models on 29k, 5M, 10M, 20M, & 205M rows of Dolma dataset using pico-lm
-
-
ThomasTheMaker/tiny-Dolma205M
0.0B • Updated • 7 -
ThomasTheMaker/pico-decoder-tiny-dolma10M-v1
Updated -
ThomasTheMaker/tiny-dolma20M
0.0B • Updated • 14 -
ThomasTheMaker/tiny-dolma10M
0.0B • Updated • 5 -
ThomasTheMaker/pico-decoder-tiny
0.0B • Updated • 27 -
ThomasTheMaker/pretokenized_wiki_en
Viewer • Updated • 448k • 318 -
ThomasTheMaker/pretokenized-dolma-100M
Updated • 47 -
ThomasTheMaker/pretokenized-dolma-10M
Viewer • Updated • 11.3M • 368 -
ThomasTheMaker/pretokenized-dolma-20M
Viewer • Updated • 22.6M • 382 -
ThomasTheMaker/pretokenized-dolma-5M
Viewer • Updated • 5.65M • 300 -
ThomasTheMaker/fineweb-edu-6parquet-processed
Updated • 29