onnx models in main is annoying

#14
by travisking - opened

@xenova would it be possible for you to stop spamming the main branch of every repo that you want to put onnx files in, and instead use... an onnx branch or some other convention?

$ find models/embedding-models/nomic-ai_modernbert-embed-base -type f -name "*.onnx"
models/embedding-models/nomic-ai_modernbert-embed-base/onnx/model.onnx
models/embedding-models/nomic-ai_modernbert-embed-base/onnx/model_bnb4.onnx
models/embedding-models/nomic-ai_modernbert-embed-base/onnx/model_fp16.onnx
models/embedding-models/nomic-ai_modernbert-embed-base/onnx/model_int8.onnx

yes, it's possible to filter these out when you download, but a) downloading models in enterprise environments is already complicated enough, being able to download the repo at all is a stretch b) it is, IMO, obnoxious to ask everybody to download extra files or put in additional effort to filter them out in every download when these files are only relevant for a subset of users

Hi there :) We actually do this by default -- you may have not seen our onnx-community organization on HF (https://huggingface.co/onnx-community).

The creators of this model specifically requested ONNX weights to be added via PR to the main repo, and you don't need to download them all when downloading the model. For example, you can download snapshots of a repo and specify ignore patterns. See the docs at https://huggingface.co/docs/huggingface_hub/v1.0.0.rc7/en/package_reference/file_download#huggingface_hub.snapshot_download or for CLI at https://huggingface.co/docs/huggingface_hub/main/en/guides/download#download-from-the-cli

Sign up or log in to comment