Thank You!
#1
by
anikifoss
- opened
Thank you for your work!
This is a rare quant that works with MI50s on vllm-gfx906 branch.
Your welcome :) I'm happy that this quant can work on your machine!
This quant is not the result of my work alone, but also the AWQ implementation of vllm-project/llm-compressor.