Fix Tokenizer Class

#2
by lstama - opened

Huggingface's transformers class doesn't have BloomTokenizer, only BloomTokenizerFast (that's also used in AutoTokenizer).
https://github.com/huggingface/transformers/issues/18178
https://github.com/huggingface/transformers/pull/18005

Fixes!

yodi changed pull request status to merged

Sign up or log in to comment