bigscience
/

tokenizer

Model card Files Files and versions Community

Tokenizer used for all BLOOM models

Tokenizer information are provided at https://huggingface.co/bigscience/bloom#preprocessing

TODO: point to paper once it comes out with extra details on the tokenizer

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference API

Unable to determine this model's library. Check the docs .

Space using bigscience/tokenizer 1