exlama quant
#1
by
Skorcht
- opened
can you upload an exlama quant? thnaks
A friend of mine is quanting the model, 6bpw is up and others are being worked on.
https://huggingface.co/lucyknada/cgato_Nemo-12b-Humanize-KTO-v0.1-exl2
cgato
changed discussion status to
closed