Tokenizer
#1
by
Zeus0809
- opened
Is there a tokenizer you for this model that you can post? I'm trying to use the model with Llama Index and it requires a tokenizer. Thanks.
If you need a HuggingFace-style tokenizer, the base model is here: https://huggingface.co/nomic-ai/nomic-embed-text-v2-moe
That can be used with AutoTokenizer.
Cebtenzzre
changed discussion status to
closed