"model_max_length" in tokenizer_config.json is set to 2048

by go-inoue - opened 27 days ago

27 days ago

Hi,

I noticed that the model_max_length argument in tokenizer_config.json is set to 2048. Shouldn't this be 8192 for an 8k context model?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment