Fix broken chat formatting with chat_template. Possible fix to degraded experiences across inference providers
#78
by
harrisonvanderbyl
- opened
No description provided.
harrisonvanderbyl
changed pull request title from
[featherless.ai] Fix broken chat formatting with chat_template. Possible fix to degraded experiences across inference providers
to Fix broken chat formatting with chat_template. Possible fix to degraded experiences across inference providers
Previously had a bug that we were using r1 tokenizer for v3,
Users complained of significant decrease in quality after we fixed the bug.
Comparing the tokenizers, v3 tokenizer appears to be missing some control characters in the chat_template compared to r1.