from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("israel/AmhWordPieceTokenizer")
encoding = tokenizer.encode("ኮሌጁ ቢያስተምርም ወደስራ የሚመድባቸው መንግስት ነው abcs")
encoding.tokens
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.