Hugging Face's logo

HuggingFaceTB
/
cosmo2-tokenizer

Transformers
Inference Endpoints
Model card Files Community

cosmo2-tokenizer

Tokenizer for the training of cosmo2. This tokenizer was trained on 1M samples from:

  • FineWeb-Edu 70%
  • Cosmopedia v2 15%
  • StarCoderData 8%
  • OpenWebMath 5%
  • StackOverFlow 2%
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model’s pipeline type.

Spaces using HuggingFaceTB/cosmo2-tokenizer 19