
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16
Text Generation
•
58B
•
Updated
•
1.77k
•
12
Accurate INT4 quantized models by Neural Magic, ready for use with vLLM!