any plans to open this repo up?
#1
by
veden
- opened
Was wanting to make some quants for myself in w4a16 and possibly fp8-dynamic.
Thanks for all your work you do for the community.
Seconded - I've noticed there are still no exl2 quants. Exl3 is great, but it's still hard to daily drive it because things like tensor parallelism are still missing. If there are no such quants by the time my access request is granted or the repo is ungated, I'd happy make some.
Opened. I heard EXL2 doesn't support Nemotron
thank you
Opened. I heard EXL2 doesn't support Nemotron
That's just the 253B version