Hugging Face's logo

Spaces:
Ahmadzei
/
RAG
Runtime error

App Files Community
RAG / chunked /content_aware_chunking /_fast_tokenizers /chunk_0.txt
Ahmadzei's picture
Ahmadzei
update 1
57bdca5
raw
history blame
105 Bytes
 Use tokenizers from 🤗 Tokenizers
The [PreTrainedTokenizerFast] depends on the 🤗 Tokenizers library.