jusjinuk/layerwise-Meta-Llama-3-8B-w2-redpajama_s1024_blk4096_g1_iter3_cd4_nosal
Updated
•
78
GuidedQuant (LNQ)
Model starting with "layerwise-{$model}-w{$num_bits}-" is {$num_bits}-bits quantized model.
-
-
jusjinuk/layerwise-Meta-Llama-3-8B-w3-redpajama_s1024_blk4096_g1_iter3_cd4_nosal
Updated • 89 -
jusjinuk/layerwise-Meta-Llama-3-8B-w4-redpajama_s1024_blk4096_g1_iter3_cd4_nosal
Updated • 11 -
jusjinuk/layerwise-Meta-Llama-3-70B-w2-redpajama_s1024_blk4096_g1_iter2_cd4_nosal
Updated • 61 -
jusjinuk/layerwise-Meta-Llama-3-70B-w3-redpajama_s1024_blk4096_g1_iter2_cd4_nosal
Updated • 11 -
jusjinuk/layerwise-Meta-Llama-3-70B-w4-redpajama_s1024_blk4096_g1_iter2_cd4_nosal
Updated • 11 -
jusjinuk/layerwise-Llama-2-7b-hf-w2-redpajama_s1024_blk4096_g1_iter3_cd4_nosal
Updated • 69 -
jusjinuk/layerwise-Llama-2-7b-hf-w3-redpajama_s1024_blk4096_g1_iter3_cd4_nosal
Updated • 89 -
jusjinuk/layerwise-Llama-2-7b-hf-w4-redpajama_s1024_blk4096_g1_iter3_cd4_nosal
Updated • 1.29k -
jusjinuk/layerwise-Llama-2-13b-hf-w2-redpajama_s1024_blk4096_g1_iter3_cd4_nosal
Updated • 63 -
jusjinuk/layerwise-Llama-2-13b-hf-w3-redpajama_s1024_blk4096_g1_iter3_cd4_nosal
Updated • 13 -
jusjinuk/layerwise-Llama-2-13b-hf-w4-redpajama_s1024_blk4096_g1_iter3_cd4_nosal
Updated • 28 -
jusjinuk/layerwise-Llama-2-70b-hf-w2-redpajama_s1024_blk4096_g1_iter2_cd4_nosal
Updated • 39 -
jusjinuk/layerwise-Llama-2-70b-hf-w3-redpajama_s1024_blk4096_g1_iter2_cd4_nosal
Updated • 27 -
jusjinuk/layerwise-Llama-2-70b-hf-w4-redpajama_s1024_blk4096_g1_iter2_cd4_nosal
Updated • 27