Are these better than regular (non-qat) ones?

#1
by CHNtentes - opened

Hi, I've read your dynamic v2 doc, great work.

One thing I've noticed is that, in your table comparing qat to non-qat ggufs, for most part the qat ones have lower scores.

So does it mean I should use ggufs from unsloth/gemma-3-12b-it-GGUF instead?

Either and similar. Non QAT is probably better for now

Sign up or log in to comment