Exl2 Quantized
#2
by
rjmehta
- opened
Amazing model. @LoneStriker Can you please quantize this one?
Hi @rjmehta ,It is in our plan. Soon will be uploaded )
Hi
@rjmehta
, this is our quantized model:
https://huggingface.co/MTSAIR/MultiVerse_70B_AWQ