---
license: apache-2.0
base_model:
- anthracite-core/Mistral-Small-3.1-24B-Instruct-2503-HF
pipeline_tag: text-generation
---
# Currently uploading with slow german internet

- upload with 5MB/s running slowly.... 
  - order: IQ4_XS Q4_K_M Q5_K_M Q6_K IQ4_NL IQ2_S IQ2_XS IQ2_XXS IQ3_S IQ3_XS IQ3_XXS Q4_K_S Q5_K_S Q8_0 Q4_0 IQ2_M IQ3_M IQ1_S;
- based on https://huggingface.co/anthracite-core/Mistral-Small-3.1-24B-Instruct-2503-HF
- quantized **with imatrix** via bf16
- no vision support
- **BETA** & **not** final! needs official configs!