Guys, Rust inference of Kokoro!
#35
by
lucasjin
- opened
Really cool to see it in rust, hopefully it eventually gets added to candle as well
Yeah, candle might be my second attempt. Two things need to be done at first:
- The model if uses transformer, can be accelerate with candle;
- Candle can achieve a more reasonable speed on GPU with fp16;
However, current status in Rust is fully work! it can be used in WASM or embeded scenario.