give the end word directly
#1
by
animax
- opened
when I call with
<|im_start|>user\nHello<|im_end|>\n<|im_start|>assistant\n
it returns end word immediately, does there anything missing from my prompt format?
Which size are you using?
Works fine for me in LM Studio which is odd..
I am using the Q8 version, I am running with llama.cpp, but it seems working after add think tag