Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
codelion 's Collections
Ellora
Internal Coherence Maximization
Pre-training Dataset Samples
Pivotal Token Search
Securade.ai

Pre-training Dataset Samples

updated 19 days ago

A collection of pre-training datasets samples of sizes 10M, 100M and 1B tokens. Ideal for use in quick experimentation and ablations.

Upvote
1

  • codelion/fineweb-edu-10M

    Viewer • Updated 20 days ago • 9.46k • 78

  • codelion/fineweb-edu-100M

    Viewer • Updated 20 days ago • 115k • 85

  • codelion/fineweb-edu-1B

    Viewer • Updated 19 days ago • 970k • 124

  • codelion/dclm-baseline-10M

    Viewer • Updated 20 days ago • 7.95k • 82

  • codelion/dclm-baseline-100M

    Viewer • Updated 20 days ago • 77.2k • 84

  • codelion/dclm-baseline-1B

    Viewer • Updated 19 days ago • 774k • 116

  • sumuks/essential-web-v1.0-sample-10M

    Viewer • Updated 23 days ago • 18.3k • 98 • 1

  • sumuks/essential-web-v1.0-sample-100M

    Viewer • Updated 23 days ago • 183k • 68

  • sumuks/essential-web-v1.0-sample-1B

    Viewer • Updated 23 days ago • 1.83M • 102
Upvote
1
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs