Hugging Face's logo

MaziyarPanahi
/
Yi-9B-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
arxiv:2311.16502
arxiv:2401.11944
has_space
text-generation-inference
Model card Files Community
3

Thanks for your quants!

#3
by Cran-May - opened
Discussion
Cran-May

Would you mind making a GGUF quantization for feeltheAGI/yi-super-9B as well?
https://huggingface.co/feeltheAGI/yi-super-9B

MaziyarPanahi
 Owner

@Cran-May of course! Uploads will be available here: https://huggingface.co/MaziyarPanahi/yi-super-9B-GGUF

Sign up or log in to comment