Update README.md
Browse files
README.md
CHANGED
@@ -116,9 +116,18 @@ license_name: llama4
|
|
116 |
<img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
|
117 |
</a>
|
118 |
</div>
|
119 |
-
<h1 style="margin-top: 0rem;">✨
|
120 |
</div>
|
121 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
122 |
- Fine-tune Llama-4-Scout on a single H100 80GB GPU using Unsloth!
|
123 |
- Read our Blog about Llama 4 support: [unsloth.ai/blog/llama4](https://unsloth.ai/blog/llama4)
|
124 |
- View the rest of our notebooks in our [docs here](https://docs.unsloth.ai/get-started/unsloth-notebooks).
|
|
|
116 |
<img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
|
117 |
</a>
|
118 |
</div>
|
119 |
+
<h1 style="margin-top: 0rem;">✨ Run Unsloth Dynamic Llama 4!</h1>
|
120 |
</div>
|
121 |
|
122 |
+
|MoE Bits|Type|Disk Size|HF Link|
|
123 |
+
|:-|:-|:-|:-|
|
124 |
+
|1.78bit|IQ1\_S|**33.8GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ1_S.gguf)|
|
125 |
+
|1.93bit|IQ1\_M|**35.4B**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ1_M.gguf)|
|
126 |
+
|2.42-bit|IQ2\_XXS|**38.6GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ2_XXS.gguf)|
|
127 |
+
|2.71-bit|Q2\_K\_XL|**42.2GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-Q2_K_XL.gguf)|
|
128 |
+
|3.5-bit|Q3\_K\_XL|**52.9GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ3_K_XL)|
|
129 |
+
|4.5-bit|Q4\_K\_XL|**65.6GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ4_K_XL)|
|
130 |
+
|
131 |
- Fine-tune Llama-4-Scout on a single H100 80GB GPU using Unsloth!
|
132 |
- Read our Blog about Llama 4 support: [unsloth.ai/blog/llama4](https://unsloth.ai/blog/llama4)
|
133 |
- View the rest of our notebooks in our [docs here](https://docs.unsloth.ai/get-started/unsloth-notebooks).
|