Update README.md
Browse files
README.md
CHANGED
@@ -113,7 +113,7 @@ license_name: llama4
|
|
113 |
<img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
|
114 |
</a>
|
115 |
</div>
|
116 |
-
<h1 style="margin-top: 0rem;"
|
117 |
</div>
|
118 |
<p style="margin-bottom: 0;">
|
119 |
<em><a href="https://docs.unsloth.ai/basics/tutorial-how-to-run-and-fine-tune-llama-4">Read our Guide</a> to see how to Fine-tune & Run Llama 4 correctly.</em>
|
@@ -128,6 +128,16 @@ license_name: llama4
|
|
128 |
|3.5-bit|Q3\_K\_XL|**52.9GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ3_K_XL)|Great|
|
129 |
|4.5-bit|Q4\_K\_XL|**65.6GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ4_K_XL)|Best|
|
130 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
131 |
- Fine-tune Llama-4-Scout on a single H100 80GB GPU using Unsloth!
|
132 |
- Read our Blog about Llama 4 support: [unsloth.ai/blog/llama4](https://unsloth.ai/blog/llama4)
|
133 |
- View the rest of our notebooks in our [docs here](https://docs.unsloth.ai/get-started/unsloth-notebooks).
|
|
|
113 |
<img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
|
114 |
</a>
|
115 |
</div>
|
116 |
+
<h1 style="margin-top: 0rem;">🦙 Run Unsloth Dynamic Llama 4!</h1>
|
117 |
</div>
|
118 |
<p style="margin-bottom: 0;">
|
119 |
<em><a href="https://docs.unsloth.ai/basics/tutorial-how-to-run-and-fine-tune-llama-4">Read our Guide</a> to see how to Fine-tune & Run Llama 4 correctly.</em>
|
|
|
128 |
|3.5-bit|Q3\_K\_XL|**52.9GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ3_K_XL)|Great|
|
129 |
|4.5-bit|Q4\_K\_XL|**65.6GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ4_K_XL)|Best|
|
130 |
|
131 |
+
**Chat template/prompt format:**
|
132 |
+
```
|
133 |
+
<|begin_of_text|><|header_start|>system<|header_end|>
|
134 |
+
|
135 |
+
{system_prompt}<|eot|><|header_start|>user<|header_end|>
|
136 |
+
|
137 |
+
{prompt}<|eot|><|header_start|>assistant<|header_end|>
|
138 |
+
```
|
139 |
+
|
140 |
+
# 🦙 Fine-tune Llama 4 with Unsloth!
|
141 |
- Fine-tune Llama-4-Scout on a single H100 80GB GPU using Unsloth!
|
142 |
- Read our Blog about Llama 4 support: [unsloth.ai/blog/llama4](https://unsloth.ai/blog/llama4)
|
143 |
- View the rest of our notebooks in our [docs here](https://docs.unsloth.ai/get-started/unsloth-notebooks).
|