shimmyshimmer commited on
Commit
83fb7b5
·
verified ·
1 Parent(s): a3eb845

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -116,9 +116,18 @@ license_name: llama4
116
  <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
117
  </a>
118
  </div>
119
- <h1 style="margin-top: 0rem;">✨ Fine-tune Llama 4 with Unsloth!</h1>
120
  </div>
121
 
 
 
 
 
 
 
 
 
 
122
  - Fine-tune Llama-4-Scout on a single H100 80GB GPU using Unsloth!
123
  - Read our Blog about Llama 4 support: [unsloth.ai/blog/llama4](https://unsloth.ai/blog/llama4)
124
  - View the rest of our notebooks in our [docs here](https://docs.unsloth.ai/get-started/unsloth-notebooks).
 
116
  <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
117
  </a>
118
  </div>
119
+ <h1 style="margin-top: 0rem;">✨ Run Unsloth Dynamic Llama 4!</h1>
120
  </div>
121
 
122
+ |MoE Bits|Type|Disk Size|HF Link|
123
+ |:-|:-|:-|:-|
124
+ |1.78bit|IQ1\_S|**33.8GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ1_S.gguf)|
125
+ |1.93bit|IQ1\_M|**35.4B**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ1_M.gguf)|
126
+ |2.42-bit|IQ2\_XXS|**38.6GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ2_XXS.gguf)|
127
+ |2.71-bit|Q2\_K\_XL|**42.2GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-Q2_K_XL.gguf)|
128
+ |3.5-bit|Q3\_K\_XL|**52.9GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ3_K_XL)|
129
+ |4.5-bit|Q4\_K\_XL|**65.6GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ4_K_XL)|
130
+
131
  - Fine-tune Llama-4-Scout on a single H100 80GB GPU using Unsloth!
132
  - Read our Blog about Llama 4 support: [unsloth.ai/blog/llama4](https://unsloth.ai/blog/llama4)
133
  - View the rest of our notebooks in our [docs here](https://docs.unsloth.ai/get-started/unsloth-notebooks).