Creating quantization

#4
by cmp-nct - opened

Mind sharing how you created this quantization ? Maybe sharing the code for it ?
Maybe I'm just clumsy, the new mxfp4 code caused me issues replicating the model

Sign up or log in to comment