Should we apply for a community grant for GPU?
#13
by
1TSnakers
- opened
I guess transformers.js doesn't make use of GPU in the conversion process. But @Xenova can confirm.
I think we'd benefit from having more RAM in this space, though.
Currently, we have only 18GB RAM available, so larger models (8B+) can't be converted.
The mlx-community/mlx-my-repo space, in comparison, has 134 GB RAM.