Zephyr maximum token limit

#68

by animesh1998 - opened Mar 17

animesh1998

Mar 17

I have a question regarding the maximum token limit for the Zephyr Model 7 beta. In the config.json file of the model repository, the max_position_embeddings is set to 32768. Does this value represent the maximum token limit for the model, if not what is the maximum token limit?"

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment