How to use the quantized version

by rene-hof - opened 5 days ago

5 days ago

I tried to use the model in InvokeAI and also ran it with the diffuser code you provided. In both cases, the full FP16 model is loaded.
Can you give any hints on how to use the model in quantized version?
Thanks in advance

sunhaha123

TensorArt Studios org 3 days ago

@rene-hof https://github.com/city96/ComfyUI-GGUF

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment