Is a quantized version available?

#2
by booker - opened

Only has a 16GB memory GPU,pls upload quantized version models.

Sign up or log in to comment