HuggingFaceFW/ablation-model-fineweb-edu
Text Generation
•
2B
•
Updated
•
1.91k
•
14
📀 Dataset comparison models
1.8B models trained on 350BT to compare different pretraining datasets
-
-
HuggingFaceFW/ablation-model-fineweb-v1
Text Generation • 2B • Updated • 2.81k • 14 -
HuggingFaceFW/ablation-model-refinedweb
Text Generation • 2B • Updated • 41 • 3 -
HuggingFaceFW/ablation-model-c4
Text Generation • 2B • Updated • 32 • 4 -
HuggingFaceFW/ablation-model-dolma-v1_6
Text Generation • 2B • Updated • 35 • 2 -
HuggingFaceFW/ablation-model-slimpajama
Text Generation • 2B • Updated • 63 • 2 -
HuggingFaceFW/ablation-model-the-pile
Text Generation • 2B • Updated • 33 • 1 -
HuggingFaceFW/ablation-model-redpajama2
Text Generation • 2B • Updated • 39