ThomasTheMaker/pico-decoder-tiny-experiments
Updated
Pico LM
Pre-training 11M parameter models on 29k, 5M, 10M, 20M, & 205M rows of Dolma dataset using pico-lm
-
-
ThomasTheMaker/tiny-Dolma205M
0.0B • Updated • 3 -
ThomasTheMaker/pico-decoder-tiny-dolma10M-v1
Updated -
ThomasTheMaker/tiny-dolma20M
0.0B • Updated • 3 -
ThomasTheMaker/tiny-dolma10M
0.0B • Updated • 10 -
ThomasTheMaker/pico-decoder-tiny
0.0B • Updated • 9 -
ThomasTheMaker/pretokenized_wiki_en
Viewer • Updated • 448k • 902 -
ThomasTheMaker/pretokenized-dolma-100M
Updated • 14 -
ThomasTheMaker/pretokenized-dolma-10M
Viewer • Updated • 11.3M • 102 -
ThomasTheMaker/pretokenized-dolma-20M
Viewer • Updated • 22.6M • 6 -
ThomasTheMaker/pretokenized-dolma-5M
Viewer • Updated • 5.65M • 14 -
ThomasTheMaker/fineweb-edu-6parquet-processed
Updated • 17