provide int4 version pls...
Here is an AWQ quantized version👋: https://modelscope.cn/models/swift/QwenLong-L1-32B-AWQ
Thanks. Does anyone have them packaged in .gguf single file to be run with llama.cpp?
· Sign up or log in to comment