GPTQ Support
#1
by
warlock-edward
- opened
Very much looking forward to the GPTQ version support, looking forward to having a GPTQ release due to the inability of the graphics card to support AWQ quantization!
Just a bit curious: what graphics cards are you using that has enough VRAM for the 4bit model but don't support AWQ?
Not planned.
v2ray
changed discussion status to
closed