Update README.md
Browse files
README.md
CHANGED
|
@@ -20,6 +20,18 @@ tags:
|
|
| 20 |
- static
|
| 21 |
---
|
| 22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
# Codestral-22B-v0.1-IMat-GGUF
|
| 24 |
_Llama.cpp imatrix quantization of mistralai/Codestral-22B-v0.1 (bullerwins/Codestral-22B-v0.1-hf)_
|
| 25 |
|
|
|
|
| 20 |
- static
|
| 21 |
---
|
| 22 |
|
| 23 |
+
|
| 24 |
+
<div style="border: 2px solid #c4382d; border-left-width: 8px; padding: 16px 32px; border-radius: 0 10px 10px 0;">
|
| 25 |
+
<h3>Known Issue:</h3>
|
| 26 |
+
|
| 27 |
+
Initial version of <a href="https://huggingface.co/mistralai/Codestral-22B-v0.1">mistralai/Codestral-22B-v0.1</a> had a missing tokens for FIM (Fill In the Middle) - see <a href="https://huggingface.co/mistralai/Codestral-22B-v0.1/discussions/10#665856e3d3e05bb21be16140">discussion</a>
|
| 28 |
+
|
| 29 |
+
You may find the fixed & re-quantized versions here: <a href="https://huggingface.co/legraphista/Codestral-22B-v0.1-hf-FIM-fix">legraphista/Codestral-22B-v0.1-hf-FIM-fix</a>
|
| 30 |
+
|
| 31 |
+
</div>
|
| 32 |
+
|
| 33 |
+
<br>
|
| 34 |
+
|
| 35 |
# Codestral-22B-v0.1-IMat-GGUF
|
| 36 |
_Llama.cpp imatrix quantization of mistralai/Codestral-22B-v0.1 (bullerwins/Codestral-22B-v0.1-hf)_
|
| 37 |
|