metythorn
/

xlm-roberta-tokenizer-50k

Model card Files Files and versions Community

xlm-roberta-tokenizer-50k / tokenizer_config.json

Commit History

Add XLM-RoBERTa Khmer custom tokenizer

66e9816
verified

metythorn commited on 21 days ago