Should we apply for a community grant for GPU?

#13
by 1TSnakers - opened
ONNX Community org

I am converting some models right now, and this would be much faster if we had a GPU. I don't want to file the community grant, as I believe that would be something for @Xenova . but I am welcome to open the discussion.

ONNX Community org

I guess transformers.js doesn't make use of GPU in the conversion process. But @Xenova can confirm.

I think we'd benefit from having more RAM in this space, though.

Currently, we have only 18GB RAM available, so larger models (8B+) can't be converted.

The mlx-community/mlx-my-repo space, in comparison, has 134 GB RAM.

Sign up or log in to comment