Ctrl+K

1 contributor

History: 52 commits

eaddario

Selective quantization Q3_K_S

b0edfd7 verified 18 days ago

imatrix
Regenerate importance matrices 27 days ago
logits
Generate base model logits 2 months ago
scores
Generate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 27 days ago
.gitattributes

1.65 kB

Update .gitattributes 2 months ago
.gitignore

6.78 kB

Add .gitignore 2 months ago
DeepSeek-R1-Distill-Llama-8B-F16.gguf

16.1 GB
LFS

Convert to GGUF @ F16 2 months ago
DeepSeek-R1-Distill-Llama-8B-IQ3_M.gguf

3.47 GB
LFS

Experimental quantize+prune IQ3_M 27 days ago
DeepSeek-R1-Distill-Llama-8B-IQ3_S.gguf

3.37 GB
LFS

Experimental quantize+prune IQ3_S 27 days ago
DeepSeek-R1-Distill-Llama-8B-IQ4_NL.gguf

4.35 GB
LFS

Experimental quantize+prune IQ4_NL 27 days ago
DeepSeek-R1-Distill-Llama-8B-Q3_K_L.gguf

3.45 GB
LFS

Selective quantization Q3_K_L 18 days ago
DeepSeek-R1-Distill-Llama-8B-Q3_K_M.gguf

3.37 GB
LFS

Selective quantization Q3_K_M 18 days ago
DeepSeek-R1-Distill-Llama-8B-Q3_K_S.gguf

3.28 GB
LFS

Selective quantization Q3_K_S 18 days ago
DeepSeek-R1-Distill-Llama-8B-Q4_K_M.gguf

4.44 GB
LFS

Selective quantization Q4_K_M 18 days ago
DeepSeek-R1-Distill-Llama-8B-Q4_K_S.gguf

4.31 GB
LFS

Selective quantization Q4_K_S 18 days ago
DeepSeek-R1-Distill-Llama-8B-Q5_K_M.gguf

5.35 GB
LFS

Selective quantization Q5_K_M 18 days ago
DeepSeek-R1-Distill-Llama-8B-Q5_K_S.gguf

5.19 GB
LFS

Selective quantization Q5_K_S 18 days ago
DeepSeek-R1-Distill-Llama-8B-Q6_K.gguf

6.17 GB
LFS

Selective quantization Q6_K 18 days ago
DeepSeek-R1-Distill-Llama-8B-Q8_0.gguf

7.84 GB
LFS

Selective quantization Q8_0 18 days ago
README.md

19.5 kB

Update README.md 27 days ago