Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Max1798
/
my-tokenizer
like
0
bpe
Model card
Files
Files and versions
xet
Community
main
my-tokenizer
File size: 32 Bytes
29e1ab5
1
from tokenizers import Tokenizer
