Update config.json
#14
by
madushakv
- opened
updated the tokenizer_class to MT5Tokenizer
to prevent silent tokenizer mismatches and to make AutoTokenizer behave correctly.
updated the tokenizer_class to MT5Tokenizer
to prevent silent tokenizer mismatches and to make AutoTokenizer behave correctly.