The DeepRetrieval/DeepRetrieval-NQ-BM25-3B model is missing the model.safetensors.index.json file.

#1
by Braint - opened

Thank you to the author for the open-source work. I encountered some issues when trying to load the model β€” it seems that certain files are missing. In the repository DeepRetrieval/DeepRetrieval-NQ-BM25-3B, the model appears to lack the model.safetensors.index.json file, which prevents me from directly loading it using Transformers. However, the DeepRetrieval-TriviaQA-BM25-3B model can be loaded normally. It seems the key difference lies in the presence of the model.safetensors.index.json file.

DeepRetrieval org

Hi, we could normally load it using vllm: https://github.com/pat-jj/DeepRetrieval/blob/main/vllm_host.sh.
Could you check if it works for you?

Sign up or log in to comment