Jinja template fails on llama.cpp and has think tags for non-thinking model
#13
by
sirus
- opened
I don't think the jinja template is correct. it causes the model to start outputting part of the template if you use it with llama.cpp and while I don't know how to read or write these templates I see the use of think tags in them, and this is a non-thinking model.