|
--- |
|
license: apache-2.0 |
|
base_model: |
|
- anthracite-core/Mistral-Small-3.1-24B-Instruct-2503-HF |
|
pipeline_tag: text-generation |
|
--- |
|
# Currently uploading with slow german internet |
|
|
|
- upload with 5MB/s running slowly.... |
|
- order: IQ4_XS Q4_K_M Q5_K_M Q6_K IQ4_NL IQ2_S IQ2_XS IQ2_XXS IQ3_S IQ3_XS IQ3_XXS Q4_K_S Q5_K_S Q8_0 Q4_0 IQ2_M IQ3_M IQ1_S; |
|
- based on https://huggingface.co/anthracite-core/Mistral-Small-3.1-24B-Instruct-2503-HF |
|
- quantized **with imatrix** via bf16 |
|
- no vision support |
|
- **BETA** & **not** final! needs official configs! |
