Ahmadzei's picture
update 1
57bdca5
raw
history blame
218 Bytes
We can either continue using it in that runtime, or save it to
a JSON file for future re-use.
Loading directly from the tokenizer object
Let's see how to leverage this tokenizer object in the 🤗 Transformers library.