provide int4 version pls

#2
by Josh1026 - opened

provide int4 version pls...

Here is an AWQ quantized version👋: https://modelscope.cn/models/swift/QwenLong-L1-32B-AWQ

Thanks. Does anyone have them packaged in .gguf single file to be run with llama.cpp?

Sign up or log in to comment