Howdy! Q8_0 maybe?
Fun model. Definitely has some schizo breaks from time to time (random multilingual output and strange overruns) but has some improvements over Hexoteric buried in there. Would love a Q8_0.
Glad you're enjoying the model. I have noticed the strange multilingual outputs also, this could be a quantization issue as for example with OpenHermes 2.5 AshhLimaRP Q4_K_M I had prompt leaks which went away with Q5_K_M. I will upload the Q8_0 for you. Should be up in about 30-60 minutes.
Much obliged! Hexoteric is a real monster but it's pretty bland on the prose-side. This absolutely solves that problem and seems to do a bit better on cutting down on the poor detail attention Hexoteric suffers from, if I can just tame it...
Still pretty terrible with accents so far in my testing. But yeah! Thanks a ton. Looking forward to putting the Q8_0 through its paces.