ModelCloud
/

DeepSeek-V2-Chat-0628-gptq-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (3)

GPTQModel don't support VLLM backend for this model.

#4 opened 4 months ago by