updated the tokenizer_class to MT5Tokenizer

to prevent silent tokenizer mismatches and to make AutoTokenizer behave correctly.

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment