zetasepic
/

Rombo-LLM-V3.1-QWQ-32b-abliterate-6.5bpw-h8-exl2

you should make 4 or 4.25 bit quantization to make it usable on 24GB cards

by Onix22 - opened 5 days ago

Onix22

5 days ago

you should make 4 or 4.25 bit quantization to make it usable on 24GB cards

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment