GGUF of MLX Version of Model

#2
by jgamblin - opened

Will there be an GGUF of MLX version of the model released?

Cisco Foundation AI org

Hi @jgamblin , I believe another user made and posted some GGUF models that you can use, but we don't have any plans to release GGUF as standalone artifacts yet! If this is very useful for you, feel free to contact myself and @dhruvkedia and we can try to prioritize this for our next release!

paulkass changed discussion status to closed

Sign up or log in to comment