Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

transhumanist-already-exists
/
ayayay-tokenizer

Transformers
aya-tokenizer
ukraine
corpus-linguistics
Model card Files Files and versions Community
ayayay-tokenizer
Ctrl+K
Ctrl+K
  • 1 contributor
History: 2 commits
transhumanist-already-exists's picture
transhumanist-already-exists
add tokenizer files
0d47963 verified about 1 month ago
  • .gitattributes
    1.63 kB
    add tokenizer files about 1 month ago
  • README.md
    33 Bytes
    initial commit about 1 month ago
  • merge_info.json
    2.74 MB
    add tokenizer files about 1 month ago
  • replaced_tokens.json
    1.24 MB
    add tokenizer files about 1 month ago
  • special_tokens_map.json
    439 Bytes
    add tokenizer files about 1 month ago
  • tokenizer.json
    14.5 MB
    LFS
    add tokenizer files about 1 month ago
  • tokenizer_config.json
    8.64 kB
    add tokenizer files about 1 month ago
  • tokenizer_utf8.json
    11.5 MB
    LFS
    add tokenizer files about 1 month ago