jusjinuk
/

layerwise-Llama-2-7b-hf-w4-redpajama_s1024_blk4096_g1_iter3_cd4_nosal

Model card Files Files and versions Community

No model card

Downloads last month: 1,335

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including jusjinuk/layerwise-Llama-2-7b-hf-w4-redpajama_s1024_blk4096_g1_iter3_cd4_nosal

GuidedQuant (LNQ)

Model starting with "layerwise-{$model}-w{$num_bits}-" is {$num_bits}-bits quantized model. • 15 items • Updated 24 days ago