Hugging Face's logo

ZeroWw
/
Gemma-2-9B-It-SPPO-Iter3-GGUF

Text Generation
GGUF
English
conversational
Model card Files Community
1

Smaller quants

#1
by Stark2008 - opened
Discussion
Stark2008

Hi,

Any chance you can make smaller model quants?

ZeroWw
 Owner

Hi,

Any chance you can make smaller model quants?

I could but q4 degrades the models too much.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment