NVIDIA NIM Inference Support?

#24
by ronedgecomb - opened

Hi folks,

Currently, in the NVIDIA NIM inference, I only see older ASR models like “parakeet-1.1b-rnnt-multilingual-asr” and “canary-1b-asr” available for deployment. I’m wondering if there are plans to add this new parakeet-tdt-0.6b-v2 model to the NIM service soon?

Could anyone from NVIDIA (or others in the community) share if there’s a roadmap for updating the available models in NIM with these more recent ASR offerings? Any timeline or details would be very helpful for developers planning ahead.

Thanks in advance!

ronedgecomb changed discussion status to closed
ronedgecomb changed discussion status to open

That would be a great addition and make it more broadly available!

NVIDIA org

We are working on it. Will share when its available. Thanks for your interest!

ronedgecomb changed discussion status to closed

It is not yet available as Nim Api, why did you close the discussion? At least I could not find it?
https://build.nvidia.com/search?q=Parakeet-tdt-0.6b-v2

Sign up or log in to comment