Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
gguf-org
/
quant-type
like
0
Follow
gguf
17
GGUF
License:
mit
Model card
Files
Files and versions
xet
Community
main
quant-type
6.54 MB
2 contributors
History:
25 commits
chatpig
Upload 2 files
19711c4
verified
9 days ago
.gitattributes
Safe
3.01 kB
Upload 2 files
9 days ago
README.md
Safe
88 Bytes
Update README.md
3 months ago
i-quant-iq1_m.gguf
Safe
115 kB
xet
Upload 5 files
2 months ago
i-quant-iq1_s.gguf
Safe
103 kB
xet
Upload 5 files
2 months ago
i-quant-iq2_m.gguf
Safe
168 kB
xet
Upload 2 files
9 days ago
i-quant-iq2_s.gguf
Safe
168 kB
xet
Upload i-quant-iq2_s.gguf
2 months ago
i-quant-iq2_xs.gguf
Safe
152 kB
xet
Upload 5 files
2 months ago
i-quant-iq2_xxs.gguf
Safe
135 kB
xet
Upload 5 files
2 months ago
i-quant-iq3_m.gguf
Safe
254 kB
xet
Upload 2 files
9 days ago
i-quant-iq3_s.gguf
Safe
254 kB
xet
Upload i-quant-iq3_s.gguf with huggingface_hub
3 months ago
i-quant-iq3_xxs.gguf
Safe
226 kB
xet
Upload i-quant-iq3_xxs.gguf with huggingface_hub
3 months ago
i-quant-iq4_nl.gguf
Safe
332 kB
xet
Upload i-quant-iq4_nl.gguf with huggingface_hub
3 months ago
i-quant-iq4_xs.gguf
Safe
314 kB
xet
Upload i-quant-iq4_xs.gguf with huggingface_hub
3 months ago
k-quant-q2_k.gguf
Safe
194 kB
xet
Upload k-quant-q2_k.gguf with huggingface_hub
3 months ago
k-quant-q2_k_s.gguf
Safe
194 kB
xet
Upload k-quant-q2_k_s.gguf
about 2 months ago
k-quant-q3_k_m.gguf
Safe
254 kB
xet
Rename k-quant-q3_k.gguf to k-quant-q3_k_m.gguf
3 months ago
k-quant-q4_k_m.gguf
Safe
332 kB
xet
Rename k-quant-q4_k.gguf to k-quant-q4_k_m.gguf
3 months ago
k-quant-q5_k_m.gguf
Safe
406 kB
xet
Rename k-quant-q5_k.gguf to k-quant-q5_k_m.gguf
3 months ago
k-quant-q6_k.gguf
Safe
484 kB
xet
Upload k-quant-q6_k.gguf with huggingface_hub
3 months ago
s-quant-q4_0.gguf
Safe
332 kB
xet
Upload s-quant-q4_0.gguf with huggingface_hub
3 months ago
s-quant-q4_1.gguf
Safe
369 kB
xet
Upload s-quant-q4_1.gguf with huggingface_hub
3 months ago
s-quant-q5_0.gguf
Safe
406 kB
xet
Upload s-quant-q5_0.gguf with huggingface_hub
3 months ago
s-quant-q5_1.gguf
Safe
443 kB
xet
Upload s-quant-q5_1.gguf with huggingface_hub
3 months ago
s-quant-q8_0.gguf
Safe
627 kB
xet
Upload s-quant-q8_0.gguf with huggingface_hub
3 months ago
t-quant-tq1_0.gguf
Safe
125 kB
xet
Upload 2 files
2 months ago
t-quant-tq2_0.gguf
Safe
152 kB
xet
Upload 2 files
2 months ago
