Text Generation
Transformers
PyTorch
English
llama
custom_code
text-generation-inference

Quantized model

#2
by MaziyarPanahi - opened

Thanks for sharing this model! I quantized it for GGUF format if anyone else is interested:

https://huggingface.co/MaziyarPanahi/Yarn-Solar-10b-32k-GGUF

Sign up or log in to comment