Hugging Face's logo

unsloth
/
Llama-4-Scout-17B-16E-Instruct-GGUF

Image-Text-to-Text
Transformers
GGUF
PyTorch
llama4
facebook
unsloth
meta
llama
llama-4
imatrix
conversational
Model card Files
xet
Community
9
shimmyshimmer commited on
Commit
c3c7e4f
·
verified ·
1 Parent(s): 48a0555

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -122,7 +122,7 @@ license_name: llama4
122
  |MoE Bits|Type|Disk Size|HF Link|Accuracy|
123
  |:-|:-|:-|:-|:-|
124
  |1.78bit|IQ1\_S|**33.8GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ1_S.gguf)|Ok|
125
- |1.93bit|IQ1\_M|**35.4B**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ1_M.gguf)|Fair|
126
  |2.42-bit|IQ2\_XXS|**38.6GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ2_XXS.gguf)|Better|
127
  |2.71-bit|Q2\_K\_XL|**42.2GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-Q2_K_XL.gguf)|Suggested|
128
  |3.5-bit|Q3\_K\_XL|**52.9GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ3_K_XL)|Great|
 
122
  |MoE Bits|Type|Disk Size|HF Link|Accuracy|
123
  |:-|:-|:-|:-|:-|
124
  |1.78bit|IQ1\_S|**33.8GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ1_S.gguf)|Ok|
125
+ |1.93bit|IQ1\_M|**35.4GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ1_M.gguf)|Fair|
126
  |2.42-bit|IQ2\_XXS|**38.6GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-IQ2_XXS.gguf)|Better|
127
  |2.71-bit|Q2\_K\_XL|**42.2GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF?show_file_info=Llama-4-Scout-17B-16E-Instruct-UD-Q2_K_XL.gguf)|Suggested|
128
  |3.5-bit|Q3\_K\_XL|**52.9GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ3_K_XL)|Great|