Update README.md
Browse files
README.md
CHANGED
@@ -102,9 +102,6 @@ license_name: llama4
|
|
102 |
<p style="margin-bottom: 0; margin-top: 0;">
|
103 |
<strong>See <a href="https://huggingface.co/collections/unsloth/llama-4-67f19503d764b0f3a2a868d2">our collection</a> for versions of Llama 4 including 4-bit & 16-bit formats.</strong>
|
104 |
</p>
|
105 |
-
<p style="margin-bottom: 0;">
|
106 |
-
<em><a href="https://docs.unsloth.ai/basics/tutorial-how-to-run-and-fine-tune-llama-4">Read our Guide</a> to see how to Fine-tune & Run Llama 4 correctly.</em>
|
107 |
-
</p>
|
108 |
<div style="display: flex; gap: 5px; align-items: center; ">
|
109 |
<a href="https://github.com/unslothai/unsloth/">
|
110 |
<img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
|
@@ -118,15 +115,18 @@ license_name: llama4
|
|
118 |
</div>
|
119 |
<h1 style="margin-top: 0rem;">✨ Run Unsloth Dynamic Llama 4!</h1>
|
120 |
</div>
|
121 |
-
|
122 |
-
|
123 |
-
|
124 |
-
|
125 |
-
|
|
126 |
-
|
127 |
-
|
|
128 |
-
|
|
129 |
-
|
|
|
|
|
|
|
|
130 |
|
131 |
- Fine-tune Llama-4-Scout on a single H100 80GB GPU using Unsloth!
|
132 |
- Read our Blog about Llama 4 support: [unsloth.ai/blog/llama4](https://unsloth.ai/blog/llama4)
|
|
|
102 |
<p style="margin-bottom: 0; margin-top: 0;">
|
103 |
<strong>See <a href="https://huggingface.co/collections/unsloth/llama-4-67f19503d764b0f3a2a868d2">our collection</a> for versions of Llama 4 including 4-bit & 16-bit formats.</strong>
|
104 |
</p>
|
|
|
|
|
|
|
105 |
<div style="display: flex; gap: 5px; align-items: center; ">
|
106 |
<a href="https://github.com/unslothai/unsloth/">
|
107 |
<img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
|
|
|
115 |
</div>
|
116 |
<h1 style="margin-top: 0rem;">✨ Run Unsloth Dynamic Llama 4!</h1>
|
117 |
</div>
|
118 |
+
<p style="margin-bottom: 0;">
|
119 |
+
<em><a href="https://docs.unsloth.ai/basics/tutorial-how-to-run-and-fine-tune-llama-4">Read our Guide</a> to see how to Fine-tune & Run Llama 4 correctly.</em>
|
120 |
+
</p>
|
121 |
+
|
122 |
+
|MoE Bits|Type|Disk Size|HF Link|Accuracy|
|
123 |
+
|:-|:-|:-|:-|:-|
|
124 |
+
|1.78bit|IQ1\_S|**33.8GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ1_S.gguf)|Ok|
|
125 |
+
|1.93bit|IQ1\_M|**35.4B**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ1_M.gguf)|Fair|
|
126 |
+
|2.42-bit|IQ2\_XXS|**38.6GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ2_XXS.gguf)|Better|
|
127 |
+
|2.71-bit|Q2\_K\_XL|**42.2GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-Q2_K_XL.gguf)|Suggested|
|
128 |
+
|3.5-bit|Q3\_K\_XL|**52.9GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ3_K_XL)|Great|
|
129 |
+
|4.5-bit|Q4\_K\_XL|**65.6GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ4_K_XL)|Best|
|
130 |
|
131 |
- Fine-tune Llama-4-Scout on a single H100 80GB GPU using Unsloth!
|
132 |
- Read our Blog about Llama 4 support: [unsloth.ai/blog/llama4](https://unsloth.ai/blog/llama4)
|