inarikami

/

DeepSeek-V3-int4-TensorRT

like 15

Hi, thanks for your work on this quantization. I'm sure it's useful for many.
Is there any chance that vLLM will support this?