Could you upload Q4_0 gguf (generated by --pure)
#3
by
Sparkleholic
- opened
I've converted hf model to Q4_0 gguf by llama.cpp's convert py script with ('--pure') options.
It works, but the model generates incorrect text regardless user's prompt.
The model what I convert seems to have some problems.
Could you upload Q4_0 model in this repo?
It could be very helpful to figure out the root cause of this issue.