Does not follow instructions
#2
by
lazyDataScientist
- opened
I am getting an issue where the model does not follow any of my instructions. It is also appearing with the latest Cydonia. Anubis still follows instructions something recent might be causing the issue.
Probably the chat template.
I'm using q4 with Mistral template and Skyfall follows the OOC instructions as perfectly as Mistral Small 2409 does.
I haven't encountered this problem. I'm currently using the Mistral Tekken template. It seems to work fine with 20K context length.
Maybe it’s due to FlashAttention
@TheDrummer I adjusted the context length up to >20k and it just started working. It might be an issue with koboldcpp and my GPU.
lazyDataScientist
changed discussion status to
closed