Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
transhumanist-already-exists
/
ayayay-tokenizer
like
4
Transformers
lang-uk/malyuk
QIRIM/crh_monocorpus
24 languages
aya-tokenizer
ukraine
corpus-linguistics
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
0d47963
ayayay-tokenizer
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
transhumanist-already-exists
add tokenizer files
0d47963
verified
about 1 month ago
.gitattributes
1.63 kB
add tokenizer files
about 1 month ago
README.md
Safe
33 Bytes
initial commit
about 1 month ago
merge_info.json
Safe
2.74 MB
add tokenizer files
about 1 month ago
replaced_tokens.json
Safe
1.24 MB
add tokenizer files
about 1 month ago
special_tokens_map.json
Safe
439 Bytes
add tokenizer files
about 1 month ago
tokenizer.json
Safe
14.5 MB
LFS
add tokenizer files
about 1 month ago
tokenizer_config.json
Safe
8.64 kB
add tokenizer files
about 1 month ago
tokenizer_utf8.json
Safe
11.5 MB
LFS
add tokenizer files
about 1 month ago