GGUF format
#27
by
abdelrahmanelawady
- opened
ollama is very popular nowdays. they support GGUF. is it possible to provide that format. unfortunately pytorch and tensorflow are not as user friendly and have much more dependencies for training AI models. ollama is inference only and that makes it easier and lighter and more compatible with older machines like mine. pytorch and tensorflow don't work on my machine even in cpu only versions.
please provide GGUF format.
Hello @abdelrahmanelawady , I have shared this information with the dev team, and we may plan a release in the future. I’ll keep you updated on this.
amanrangapur
changed discussion status to
closed
Hello, any updates on this?
Hey @pricet , As of now, we are not releasing gguf anytime soon. I will get back to you if there is any change in plans.