What are the Recommended Context and Instruct Templates for this Model?

#6
by ialhabbal - opened

I am excited to try out this model, I read the model card and other information from the creator, but I couldn't find a recommendation for Context and Instruct templates to use with this model. Do I use ChatML for example or something else? Thank you!

P.S.: I will use it inside SillyTavern as front end and KoboldCPP as backend.

Suggest GEmma 2 instruct template.
However, you may find Llama 3 instruct will work too.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment