neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 Text Generation • Updated 1 day ago • 151k • 20
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • Updated 1 day ago • 9.97k • 19
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 Text Generation • Updated 1 day ago • 2.6k • 7
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 Text Generation • Updated Aug 13 • 6.02k • 9
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8 Text Generation • Updated 1 day ago • 807 • 1
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • Updated 1 day ago • 9.7k • 6
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • Updated 1 day ago • 5.07k • 10
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • Updated 1 day ago • 885 • 1
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16 Text Generation • Updated 1 day ago • 145 • 2