metadata

license: apache-2.0
base_model:
  - anthracite-core/Mistral-Small-3.1-24B-Instruct-2503-HF
pipeline_tag: text-generation

Currently uploading with slow german internet

upload with 5MB/s running slowly....
- order: IQ4_XS Q4_K_M Q5_K_M Q6_K IQ4_NL IQ2_S IQ2_XS IQ2_XXS IQ3_S IQ3_XS IQ3_XXS Q4_K_S Q5_K_S Q8_0 Q4_0 IQ2_M IQ3_M IQ1_S;
based on https://huggingface.co/anthracite-core/Mistral-Small-3.1-24B-Instruct-2503-HF
quantized with imatrix via bf16
no vision support
BETA & not final! needs official configs!