Mxfp4 gguf version
Please make mxfp4 gguf version for using it in lm studio
I've tested a Q4_K_M GGUF on both KoboldCPP and on LM Studio, and it's not very good. I've seen bouts of schizophrenia in the model, repeats, loops, etc. I've even seen refusals for things that either model would do by themselves, but not this merge.
100%! This model was made as an experiment with with experimental methods... I allowed an agent to merge a model by itself, end-to-end. From that perspective, it performs FAR better than expected. ^_^ Thanks for testing it out!
100%! This model was made as an experiment with with experimental methods... I allowed an agent to merge a model by itself, end-to-end. From that perspective, it performs FAR better than expected. ^_^ Thanks for testing it out!
It's definitely an interesting experiment. In one of it's thought processes after I yelled at it for not doing what I told it to, it thought "Qwen is the name of the model".
After that I asked it "If Qwen is the name of the model, who are you?" And it couldn't answer me.