Specify maximum context length in config

#40

by saattrupdan - opened 22 days ago

22 days ago

The configuration parameter max_position_embeddings seems to be missing, and I don't see any other parameter in the configuration or the tokenizer configuration that indicates the maximum context length of 128,000. This information is automatically pulled in the EuroEval evaluation framework, so would be great if it could be added.

lkv

Google org about 7 hours ago

Hi @saattrupdan ,

Thanks for noting us. max_position_embeddings for an google/gemma-3-12b-it model is 131072. We will update it as soon as possible. For more information, Could you please refer to this link

Thank you.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment