Hugging Face's logo

qwp4w3hyb
/
Mistral-Small-3.1-24B-Instruct-2503-HF-iMat-GGUF

Text Generation
GGUF
Inference Endpoints
conversational
Model card Files Community
qwp4w3hyb commited on
Commit
da577b6
·
verified ·
1 Parent(s): 2727143

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -5,9 +5,10 @@ base_model:
5
  pipeline_tag: text-generation
6
  ---
7
  # Currently uploading with slow german internet
 
8
  - upload with 5MB/s running slowly....
9
  - order: IQ4_XS Q4_K_M Q5_K_M Q6_K IQ4_NL IQ2_S IQ2_XS IQ2_XXS IQ3_S IQ3_XS IQ3_XXS Q4_K_S Q5_K_S Q8_0 Q4_0 IQ2_M IQ3_M IQ1_S;
10
  - based on https://huggingface.co/anthracite-core/Mistral-Small-3.1-24B-Instruct-2503-HF
11
- - quantized with imatrix via bf16
12
  - no vision support
13
  - **BETA** & **not** final! needs official configs!
 
5
  pipeline_tag: text-generation
6
  ---
7
  # Currently uploading with slow german internet
8
+
9
  - upload with 5MB/s running slowly....
10
  - order: IQ4_XS Q4_K_M Q5_K_M Q6_K IQ4_NL IQ2_S IQ2_XS IQ2_XXS IQ3_S IQ3_XS IQ3_XXS Q4_K_S Q5_K_S Q8_0 Q4_0 IQ2_M IQ3_M IQ1_S;
11
  - based on https://huggingface.co/anthracite-core/Mistral-Small-3.1-24B-Instruct-2503-HF
12
+ - quantized **with imatrix** via bf16
13
  - no vision support
14
  - **BETA** & **not** final! needs official configs!