GPTQ/AWQ

#3
by ndurkee - opened

Are there plans to add GPTQ/AWQ versions like in the past?

Also, are there any plan for official gguf?

https://modelscope.cn/models/swift/Qwen3-235B-A22B-AWQ

Here is a quantized version (Unofficial)

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment