Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
codelion 's Collections
Ellora
Internal Coherence Maximization
Pre-training Dataset Samples
Pivotal Token Search
Securade.ai

Pre-training Dataset Samples

updated 16 days ago

A collection of pre-training datasets samples of sizes 10M, 100M and 1B tokens. Ideal for use in quick experimentation and ablations.

Upvote
1

  • codelion/fineweb-edu-10M

    Viewer • Updated 17 days ago • 9.46k • 73

  • codelion/fineweb-edu-100M

    Viewer • Updated 17 days ago • 115k • 81

  • codelion/fineweb-edu-1B

    Viewer • Updated 16 days ago • 970k • 115

  • codelion/dclm-baseline-10M

    Viewer • Updated 17 days ago • 7.95k • 76

  • codelion/dclm-baseline-100M

    Viewer • Updated 17 days ago • 77.2k • 80

  • codelion/dclm-baseline-1B

    Viewer • Updated 16 days ago • 774k • 106

  • sumuks/essential-web-v1.0-sample-10M

    Viewer • Updated 20 days ago • 18.3k • 84 • 1

  • sumuks/essential-web-v1.0-sample-100M

    Viewer • Updated 20 days ago • 183k • 58

  • sumuks/essential-web-v1.0-sample-1B

    Viewer • Updated 20 days ago • 1.83M • 82
Upvote
1
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs