Hugging Face's logo

yodi
/
karina

Text Generation
Transformers
PyTorch
Safetensors
Indonesian
bloom
text-generation-inference
Model card Files Community
2

Fix Tokenizer Class

#2
by lstama - opened
base: refs/heads/main
←
from: refs/pr/2
Discussion Files changed
+1
-1
lstama

Huggingface's transformers class doesn't have BloomTokenizer, only BloomTokenizerFast (that's also used in AutoTokenizer).
https://github.com/huggingface/transformers/issues/18178
https://github.com/huggingface/transformers/pull/18005

Fix Tokenizer Class5cc473eb
yodi
 Owner

Fixes!

yodi changed pull request status to merged
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment