AWQ quants of base models.

#2
by ELigoP - opened

Thank you for you work first!
Is it seen as viable to make base models quants (specifically AWQ)? People use them less and usually for pretraining, but there are cases (e.g. code completion) when they are good too.

Sign up or log in to comment