FineData
community
AI & ML interests
We release large pre-training datasets to accelerate open LLM development. Part of the Hugging Face Science team (hf.co/science)
Recent Activity
View all activity
Papers
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
Organization Card
🍷 FineData
This is the home of the 🍷 FineData team, a branch of the 🤗 Hugging Face Science Team releasing large scale pre-training datasets to accelerate open LLM development.
- 🍷 FineWeb: A 15T tokens English dataset for LLM pre-training. See the blogpost and paper.
- 📚 FineWeb-Edu: a filtered subset of the most educational content from FineWeb.
- 🥂 FineWeb2: an extension of FineWeb to over 1000 languages. See the paper.
- 📄 FinePDFs: 3T tokens of text data extracted from PDFs sourced from the Web.
- 🌐 FineWiki: an updated, better extracted version of Wikipedia in 300+ languages.
- 📄 FinePDFs-Edu: 350B+ highly educational tokens filtered from 📄 FinePDFs
spaces
6
Running
8
FineWiki Viewer
🌐
Viewer to explore the finewiki dataset
Running
Featured
1.2k
FineWeb: decanting the web for the finest text data at scale
🍷
Generate high-quality text data for LLMs using FineWeb
Running
83
Scaling FineWeb to 1000+ languages: Step 1: finding signal in 100s of evaluation tasks
📝
Evaluate multilingual models using FineTasks
Build error
Tasks Explorer
🏢
Explore and analyze experiment results
Runtime error
4
Datasets Metrics Explorer
📊
Launch an interactive demo interface
models
105
HuggingFaceFW/finepdfs_edu_classifier_eng_Latn
0.4B
•
Updated
•
43
•
2
HuggingFaceFW/finepdfs_dclm_classifier_eng_Latn
0.4B
•
Updated
•
38
HuggingFaceFW/finepdfs_edu_classifier_v2_eng_Latn
0.4B
•
Updated
•
27
HuggingFaceFW/finepdfs_ocr_quality_classifier_eng_Latn
0.4B
•
Updated
•
16
HuggingFaceFW/finepdfs_edu_classifier_guj_Gujr
0.3B
•
Updated
•
23
HuggingFaceFW/finepdfs_edu_classifier_nno_Latn
0.3B
•
Updated
•
17
HuggingFaceFW/finepdfs_edu_classifier_kaz_Cyrl
0.3B
•
Updated
•
14
HuggingFaceFW/finepdfs_edu_classifier_tam_Taml
0.3B
•
Updated
•
18
HuggingFaceFW/finepdfs_edu_classifier_azj_Latn
0.3B
•
Updated
•
12
HuggingFaceFW/finepdfs_edu_classifier_afr_Latn
0.3B
•
Updated
•
19
datasets
15
HuggingFaceFW/finepdfs
Updated
•
41.8k
•
680
HuggingFaceFW/finepdfs-edu
Viewer
•
Updated
•
49.5M
•
14.2k
•
49
HuggingFaceFW/fineweb-2
Viewer
•
Updated
•
4.48B
•
93.5k
•
700
HuggingFaceFW/finewiki
Viewer
•
Updated
•
61.6M
•
19.6k
•
263
HuggingFaceFW/clean-wikipedia
Viewer
•
Updated
•
61.2M
•
1.16k
•
23
HuggingFaceFW/finepdfs_lang_classification_tmp
Updated
•
23
HuggingFaceFW/ocr-annotations
Viewer
•
Updated
•
1.62k
•
152
•
15
HuggingFaceFW/finepdfs_lang_classification
Viewer
•
Updated
•
3.08M
•
18.7k
•
4
HuggingFaceFW/finepdfs_eng_Latn_labeled
Viewer
•
Updated
•
1.3M
•
699
•
2
HuggingFaceFW/finepdfs_fw_edu_labeled
Viewer
•
Updated
•
18.8M
•
361
•
3