neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8-dynamic Text Generation • Updated Oct 19, 2024 • 156 • 14
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 Text Generation • Updated Oct 10, 2024 • 279 • 12
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8 Text Generation • Updated Dec 3, 2024 • 292 • 2
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16 Text Generation • Updated Oct 9, 2024 • 57 • 2