Update tokenizer_config.json

#8
by quaeast - opened

Add model_max_length param to tokenizer_config

Cannot merge
This branch has merge conflicts in the following files:
  • tokenizer_config.json
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment