Quantized MTP head of Deepseek R1. For use with the Unsloth's Q4_K quants.
Llama.cpp does not support MTP heads, but vLLM does.
- Downloads last month
- 52
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no library tag.
Model tree for pdelobelle/DeepSeek-R1-GGUF-MTP
Base model
deepseek-ai/DeepSeek-R1