vram

#2
by rakmik - opened

requirements vram

How many GB of the model does it need vram?

At 8192 ctx it will fit on a 24GB gpu

thank you

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment