provide int4 version pls
#2
by
Josh1026
- opened
provide int4 version pls...
Thanks. Does anyone have them packaged in .gguf single file to be run with llama.cpp?
Thanks. Does anyone have them packaged in .gguf single file to be run with llama.cpp?
Here is a Q4_K_M version (https://huggingface.co/mradermacher/QwenLong-L1-32B-GGUF/blob/main/QwenLong-L1-32B.Q4_K_M.gguf) from the community.
Thank you! :-)