Use tokenizers from 🤗 Tokenizers The [PreTrainedTokenizerFast] depends on the 🤗 Tokenizers library.