qwp4w3hyb
/

Mistral-Small-3.1-24B-Instruct-2503-HF-iMat-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

qwp4w3hyb commited on 5 days ago

Commit

2727143

·

verified ·

1 Parent(s): fd4ba22

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -4,7 +4,9 @@ base_model:
 - anthracite-core/Mistral-Small-3.1-24B-Instruct-2503-HF
 pipeline_tag: text-generation
 ---
-# Currently uploading with slow german internet ETA ~ 1:15-1:45AM GMT
 - based on https://huggingface.co/anthracite-core/Mistral-Small-3.1-24B-Instruct-2503-HF
 - quantized with imatrix via bf16
 - no vision support

 - anthracite-core/Mistral-Small-3.1-24B-Instruct-2503-HF
 pipeline_tag: text-generation
 ---
+# Currently uploading with slow german internet
+- upload with 5MB/s running slowly....
+  - order: IQ4_XS Q4_K_M Q5_K_M Q6_K IQ4_NL IQ2_S IQ2_XS IQ2_XXS IQ3_S IQ3_XS IQ3_XXS Q4_K_S Q5_K_S Q8_0 Q4_0 IQ2_M IQ3_M IQ1_S;
 - based on https://huggingface.co/anthracite-core/Mistral-Small-3.1-24B-Instruct-2503-HF
 - quantized with imatrix via bf16
 - no vision support