Quantized model
#2
by
MaziyarPanahi
- opened
Thanks for sharing this model! I quantized it for GGUF format if anyone else is interested:
https://huggingface.co/MaziyarPanahi/Yarn-Solar-10b-32k-GGUF