NIM Serverless Inference API - a nvidia Collection

nvidia 's Collections

QLIP

Cosmos

DMC

AceMath

Cosmos Tokenizer

Eagle 2

NeMo Audio Codecs

Hymba

Optimized ONNX models for NVIDIA RTX GPUs

Riva

Llama-3.1-Nemotron-70B

Nemotron 4 340B

SteerLM

Canary

RLHF

Llama3-ChatQA-1.5

SSMs

BigVGAN

RADIO

NIM Serverless Inference API

Model Optimizer

Llama3-ChatQA-2

NeMo Curator - Classifier Models

NIM Serverless Inference API

updated Jan 17

Models in this collection are available for inference via a serverless API powered by NVIDIA NIM.

meta-llama/Llama-3.1-8B-Instruct

Text Generation • Updated Sep 25, 2024 • 6.12M • • 3.66k

Note NIM LLM deployed with H100 x 1
meta-llama/Llama-3.1-70B-Instruct

Text Generation • Updated Dec 15, 2024 • 380k • • 790

Note NIM LLM deployed with H100 x 4
meta-llama/Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Sep 25, 2024 • 14.7k • 186

Note NIM LLM deployed with H100 x 8
meta-llama/Meta-Llama-3-8B-Instruct

Text Generation • Updated Sep 27, 2024 • 1.78M • • 3.83k

Note NIM LLM deployed with H100 x 1
meta-llama/Meta-Llama-3-70B-Instruct

Text Generation • Updated Dec 15, 2024 • 120k • • 1.46k

Note NIM LLM deployed with H100 x 4
mistralai/Mistral-7B-Instruct-v0.3

Text Generation • Updated Aug 21, 2024 • 566k • • 1.39k

Note NIM LLM deployed with H100 x 2
mistralai/Mixtral-8x7B-Instruct-v0.1

Text Generation • Updated Aug 19, 2024 • 529k • • 4.31k

Note NIM LLM deployed with H100 x 2
mistralai/Mixtral-8x22B-Instruct-v0.1

Text Generation • Updated Oct 3, 2024 • 154k • • 713

Note NIM LLM deployed with H100 x 8