wired performance between 7b nocot cot and normal version
#6
by
dd332
- opened
when use Tifa-DeepsexV2-7b-0218-Q8.gguf, it worked.
but when use Tifa-DeepsexV2-7b-Cot-0222-Q8.gguf and Tifa-DeepsexV2-7b-noCot-0222-Q8.gguf, question happend.
same prompt and other settings(tempature / tempature ...)
Tifa-DeepsexV2-7b-Cot-0222-Q8.gguf can chat with.
but Cot and noCot version output repeat novel, again and again. not chat like a robot.
why it happened?
dd332
changed discussion status to
closed
dd332
changed discussion status to
open
Same situation with 0228-NoCot and 0301-Cot.
Already set prompt to play as a role, I still got the response as continuation writing.