Text Generation
Transformers
Safetensors
llama
text-generation-inference

Quantized model

#6
by MaziyarPanahi - opened

Thanks for sharing this model with the community, I have quantized it in GGUF if anyone needs it:
https://huggingface.co/MaziyarPanahi/Yi-9B-GGUF

thanks!

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment