apply_chat_template works with English but does not work with Dutch?
#5
by
alijawad07
- opened
Hi, I am building a multilingual RAG application, which can act as QnA chat bot. However when I use tokenizer.apply_chat_template() and give the question in english, it gives me correct and accurate response, however if I give this a question in dutch, the response is empty from the model. What am I missing here? Any help in this regard will be highly appreciated. Thanks
If i do not apply chat template, it works fine but give garbage at the end and I am unable to control it since I do not have the ending token.
@ptrdvn any help on this will be highly appreciated, since Im in the middle of my project. thanks