---
license: apache-2.0
---

https://huggingface.co/mistralai/Mistral-Small-24B-Base-2501

Q6_K_XL: Q6_K weights, F16 output, F16 embed

Fits 24K CTX on a 24GiB GPU