---
license: apache-2.0
pipeline_tag: text-generation
tags:
- gguf
---
GGUF quants for [Mistral Small 3.1 Instruct 24B](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503), compatible with llama.cpp in the Mistral format.

Use the Mistral chat template.

Only the text component has been converted to GGUF, does not work as a vision model.

**Coming soon!**