Chat template cleanups + latest fixes

#76
by Rocketknight1 HF Staff - opened

This template handles newlines in the template correctly, and also correctly handles tool CoTs (dropping them after a <|final|> message has been emitted)

May I ask whether these changes would need to be propagated across all GGUFs made by other parties (e.g. unsloth) and therefore require recreation and re-downloading please?

It seems as though even the slightest changes in the chat template can cause big changes in the quality of output, so it's hard to discern whether those in this pull request are for readability or functional improvements.

These are mostly readability changes, but two changes affect how tool calls in long chats are rendered. They will probably improve model performance in those cases, but I'm not sure how significant it is!

zhuohan123 changed pull request status to merged
This comment has been hidden (marked as Off-Topic)
This comment has been hidden (marked as Graphic Content)

Sign up or log in to comment