https://huggingface.co/blog/autoround
#4
by
21world
- opened
https://huggingface.co/blog/autoround
AutoRound now supports all GGUF q*_k_s formats, shows clear advantage in most q4_k_s scenarios and up to 2.0x accuracy gain in q2_k_s
Interesting! We're going to take a look and update you if we're going to use this new formula! :D Thanks so much
shimmyshimmer
changed discussion status to
closed