common-pile/arxiv_abstracts_filtered
Viewer
•
Updated
•
2.5M
•
48
Common Pile v0.1 Filtered Data
An LLM pre-training dataset produced by filtering and deduplicating the raw text collected in the Common Pile v0.1
-
-
common-pile/arxiv_papers_filtered
Viewer • Updated • 309k • 36 -
common-pile/biodiversity_heritage_library_filtered
Viewer • Updated • 16.5M • 46 -
common-pile/caselaw_access_project_filtered
Viewer • Updated • 5.5M • 69 -
common-pile/cccc_filtered
Viewer • Updated • 10.8M • 106 -
common-pile/data_provenance_initiative_filtered
Viewer • Updated • 3.51M • 47 -
common-pile/doab_filtered
Viewer • Updated • 404k • 44 -
common-pile/foodista_filtered
Preview • Updated • 49 -
common-pile/github_archive_filtered
Viewer • Updated • 23.3M • 53 -
common-pile/library_of_congress_filtered
Viewer • Updated • 128k • 49 -
common-pile/libretexts_filtered
Viewer • Updated • 40k • 47 -
common-pile/news_filtered
Viewer • Updated • 127k • 58 -
common-pile/oercommons_filtered
Viewer • Updated • 5.25k • 43 -
common-pile/peS2o_filtered
Viewer • Updated • 6.09M • 144 -
common-pile/pre_1929_books_filtered
Viewer • Updated • 122k • 89 -
common-pile/pressbooks_filtered
Viewer • Updated • 54.5k • 46 -
common-pile/project_gutenberg_filtered
Viewer • Updated • 57.1k • 75 -
common-pile/public_domain_review_filtered
Viewer • Updated • 1.41k • 45 -
common-pile/pubmed_filtered
Viewer • Updated • 4.77M • 82 -
common-pile/python_enhancement_proposals_filtered
Viewer • Updated • 655 • 46 -
common-pile/regulations_filtered
Viewer • Updated • 192k • 46 -
common-pile/stackexchange_filtered
Viewer • Updated • 27.5M • 214 • 1 -
common-pile/stackv2_edu_filtered
Viewer • Updated • 57M • 210 -
common-pile/stackv2_html_filtered
Viewer • Updated • 1.67M • 65 -
common-pile/ubuntu_irc_filtered
Viewer • Updated • 216k • 72 -
common-pile/uk_hansard_filtered
Viewer • Updated • 47.9k • 88 -
common-pile/usgpo_filtered
Viewer • Updated • 2.34M • 86 -
common-pile/uspto_filtered
Viewer • Updated • 14.4M • 452 -
common-pile/wikimedia_filtered
Viewer • Updated • 12.9M • 102 -
common-pile/wikiteam_filtered
Viewer • Updated • 10.2M • 95 -
common-pile/youtube_filtered
Viewer • Updated • 986k • 86