Edge LLM Variants x2
Collection
custom llms
โข
8 items
โข
Updated
โข
1
Draco-CoderMini-3B is a compact, coding-optimized language model built on the Qwen2 architecture, tailored for high-accuracy code generation, debugging, and technical reasoning. With 3 billion parameters, it strikes a balance between power and deployability, making it an ideal assistant for developers, educators, and engineers working in constrained environments or requiring fast inference.
File Name | Size | Format |
---|---|---|
Draco-CoderMini-3B.BF16.gguf | 6.18 GB | BF16 |
Draco-CoderMini-3B.F16.gguf | 6.18 GB | F16 |
Draco-CoderMini-3B.F32.gguf | 12.3 GB | F32 |
.gitattributes | 1.75 kB | - |
README.md | 210 B | - |
config.json | 31 B | JSON |
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
16-bit
32-bit
Base model
Qwen/Qwen2.5-3B