Could you upload Q4_0 gguf (generated by --pure)

#3
by Sparkleholic - opened

I've converted hf model to Q4_0 gguf by llama.cpp's convert py script with ('--pure') options.

It works, but the model generates incorrect text regardless user's prompt.
The model what I convert seems to have some problems.

Could you upload Q4_0 model in this repo?
It could be very helpful to figure out the root cause of this issue.

Sign up or log in to comment