Update README.md
Browse files
README.md
CHANGED
|
@@ -28,10 +28,13 @@ tags:
|
|
| 28 |
</div>
|
| 29 |
<h1 style="margin-top: 0rem;">🐋 DeepSeek-V3.1 Usage Guidelines</h1>
|
| 30 |
</div>
|
|
|
|
|
|
|
| 31 |
- Currently, these are our preliminary dynamic quants. iMatrix quants to come soon.
|
| 32 |
- Set the temperature **~0.6** (recommended) and Top_P value of **0.95** (recommended)
|
| 33 |
- UD-Q2_K_XL (247GB) is recommended
|
| 34 |
- For complete detailed instructions, see our guide: [unsloth.ai/blog/deepseek-v3.1](https://docs.unsloth.ai/basics/deepseek-v3.1)
|
|
|
|
| 35 |
<br>
|
| 36 |
|
| 37 |
# DeepSeek-V3.1
|
|
|
|
| 28 |
</div>
|
| 29 |
<h1 style="margin-top: 0rem;">🐋 DeepSeek-V3.1 Usage Guidelines</h1>
|
| 30 |
</div>
|
| 31 |
+
|
| 32 |
+
These quants include our Unsloth chat template fixes, specifically for llama.cpp supported backends.
|
| 33 |
- Currently, these are our preliminary dynamic quants. iMatrix quants to come soon.
|
| 34 |
- Set the temperature **~0.6** (recommended) and Top_P value of **0.95** (recommended)
|
| 35 |
- UD-Q2_K_XL (247GB) is recommended
|
| 36 |
- For complete detailed instructions, see our guide: [unsloth.ai/blog/deepseek-v3.1](https://docs.unsloth.ai/basics/deepseek-v3.1)
|
| 37 |
+
|
| 38 |
<br>
|
| 39 |
|
| 40 |
# DeepSeek-V3.1
|