xlm-roberta-tokenizer-50k / tokenizer_config.json

Commit History

Add XLM-RoBERTa Khmer custom tokenizer
66e9816
verified

metythorn commited on