Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ubergarm
/
DeepSeek-V3-0324-GGUF
like
30
Text Generation
GGUF
mla
imatrix
deepseek_v3
conversational
ik_llama.cpp
License:
mit
Model card
Files
Files and versions
Community
6
Deploy
Use this model
main
DeepSeek-V3-0324-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
16 commits
ubergarm
Note ik_llama.cpp can run your existing GGUFs
7c08a2c
16 days ago
DeepSeek-V3-0324-IQ1_S_R4
Upload folder using huggingface_hub
about 2 months ago
DeepSeek-V3-0324-IQ2_K_R4
Add DeepSeek-V3-0324-IQ2_K_R4
4 months ago
DeepSeek-V3-0324-IQ4_K_R4
Release DeepSeek-V3-0324-IQ4_K_R4 and benchmarks
4 months ago
images
update README and add vram usage image
4 months ago
.gitattributes
Safe
1.67 kB
Add DeepSeek-V3-0324-IQ2_K_R4
4 months ago
DeepSeek-V3-0324.imatrix
Safe
987 MB
LFS
Add initial test imatrix data
4 months ago
README.md
49.9 kB
Note ik_llama.cpp can run your existing GGUFs
16 days ago
