ChatNT / english_tokenizer

Commit History

Rename special_tokens_map.json to english_tokenizer/special_tokens_map.json
446ebf4

Yanisadel commited on

Rename added_tokens.json to english_tokenizer/added_tokens.json
10e2e05

Yanisadel commited on

Delete english_tokenizer/tokenizer_config.json
1a5dedc

Yanisadel commited on

Delete english_tokenizer/tokenizer.model
0f53cf8

Yanisadel commited on

Delete english_tokenizer/tokenizer.json
8a1bcb1

Yanisadel commited on

Delete english_tokenizer/special_tokens_map.json
05baeb7

Yanisadel commited on

Delete english_tokenizer/added_tokens.json
56988b8

Yanisadel commited on

Rename special_tokens_map.json to english_tokenizer/special_tokens_map.json
c779b0b

Yanisadel commited on

Rename tokenizer_config.json to english_tokenizer/tokenizer_config.json
6e86071

Yanisadel commited on

Rename tokenizer.model to english_tokenizer/tokenizer.model
cac0bdc

Yanisadel commited on

Rename tokenizer.json to english_tokenizer/tokenizer.json
0f0c644

Yanisadel commited on

Rename added_tokens.json to english_tokenizer/added_tokens.json
058ea56

Yanisadel commited on