Update chat template for use with vLLM

#50
by karuko24 - opened

Not sure if this is still compatible with transformers. If not, we'll need to add some more if/else statements to the template

Alright, now it should behave the same as before with transformers while also working with vLLM

Mistral AI_ org

Thanks! (haven't looked into the chat_template json) much though

patrickvonplaten changed pull request status to merged
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment