nvidia/Llama-3.1-8B-Instruct-FP8
Text Generation
•
Updated
•
2.47k
•
15
Model Optimizer
A collection of generative models quantized and optimized with TensorRT Model Optimizer.
-
-
nvidia/Llama-3.1-405B-Instruct-FP8
Text Generation • Updated • 800 • 10 -
nvidia/Llama-3.1-70B-Instruct-FP8
Text Generation • Updated • 3.46k • 11 -
nvidia/Llama-3.1-8B-Medusa-FP8
Updated • 86 • 6 -
nvidia/Llama-3.3-70B-Instruct-FP4
Updated • 12.3k • 12 -
nvidia/Llama-3.1-405B-Instruct-FP4
Updated • 526 • 5 -
nvidia/DeepSeek-R1-FP4
Text Generation • Updated • 11.4k • 226