@danielhanchen on Hugging Face: "Deepseek V3, including GGUF + bf16 versions are now uploaded! Includes 2, 3…"

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

danielhanchen

posted an update Jan 7

Post

3250

Deepseek V3, including GGUF + bf16 versions are now uploaded!

Includes 2, 3, 4, 5, 6 and 8-bit quantized versions.

GGUFs: unsloth/DeepSeek-V3-GGUF
bf16: unsloth/DeepSeek-V3-bf16

Min. hardware requirements to run: 48GB RAM + 250GB of disk space for 2-bit.

See how to run them with examples and the full collection: unsloth/deepseek-v3-all-versions-677cf5cfd7df8b7815fc723c

23 days ago

Is there a way to request models with dynamic quants, like GGUF-my-repo? It would be nice to have DeepSeek-Coder-V2

In this post