pretraining
/

pico-tokenizer-32k

Model card Files Files and versions

pico-tokenizer-32k / tokenizer.json

minpeter's picture

Upload tokenizer

e788be0 verified 3 months ago

history contribute delete

2.76 MB

File too large to display, you can check the raw version instead.