generate gibberish response when input 3500 tokens

by chenxiangyi10 - opened Jun 5, 2023

Jun 5, 2023

I use load_in_8bit=True

Only gibberish is generated when the input token sequence length is around 3500.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment