Update?

#4
by CHNtentes - opened

Hi. Google updated their qat ggufs today, but there's no info about what has changed.
It might be worthy to check if model weights are different.

They just fixed the control tokens, as far as I can tell.
If you want to use this model with the fixed tokens, you can find it here: https://huggingface.co/Dampfinchen/google-gemma-3-12b-it-qat-q4_0-gguf-small-fix
I should probably update it here too, maybe later.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment