11
Transformers.js
๐
Upload an image to detect objects
Static Templates
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
static-templates's activity
Xenovaย
updated
a
Space
about 6 hours ago
Post
11196
We did it. Kokoro TTS (v1.0) can now run 100% locally in your browser w/ WebGPU acceleration. Real-time text-to-speech without a server. โก๏ธ
Generate 10 seconds of speech in ~1 second for $0.
What will you build? ๐ฅ
webml-community/kokoro-webgpu
The most difficult part was getting the model running in the first place, but the next steps are simple:
โ๏ธ Implement sentence splitting, allowing for streamed responses
๐ Multilingual support (only phonemization left)
Who wants to help?
Generate 10 seconds of speech in ~1 second for $0.
What will you build? ๐ฅ
webml-community/kokoro-webgpu
The most difficult part was getting the model running in the first place, but the next steps are simple:
โ๏ธ Implement sentence splitting, allowing for streamed responses
๐ Multilingual support (only phonemization left)
Who wants to help?
- 9 replies
Xenovaย
authored
a
paper
about 2 months ago
Post
6733
Introducing Kokoro.js, a new JavaScript library for running Kokoro TTS, an 82 million parameter text-to-speech model, 100% locally in the browser w/ WASM. Powered by ๐ค Transformers.js. WebGPU support coming soon!
๐ npm i kokoro-js ๐
Try it out yourself: webml-community/kokoro-web
Link to models/samples: onnx-community/Kokoro-82M-ONNX
You can get started in just a few lines of code!
Huge kudos to the Kokoro TTS community, especially taylorchu for the ONNX exports and Hexgrad for the amazing project! None of this would be possible without you all! ๐ค
The model is also extremely resilient to quantization. The smallest variant is only 86 MB in size (down from the original 326 MB), with no noticeable difference in audio quality! ๐คฏ
๐ npm i kokoro-js ๐
Try it out yourself: webml-community/kokoro-web
Link to models/samples: onnx-community/Kokoro-82M-ONNX
You can get started in just a few lines of code!
import { KokoroTTS } from "kokoro-js";
const tts = await KokoroTTS.from_pretrained(
"onnx-community/Kokoro-82M-ONNX",
{ dtype: "q8" }, // fp32, fp16, q8, q4, q4f16
);
const text = "Life is like a box of chocolates. You never know what you're gonna get.";
const audio = await tts.generate(text,
{ voice: "af_sky" }, // See `tts.list_voices()`
);
audio.save("audio.wav");Huge kudos to the Kokoro TTS community, especially taylorchu for the ONNX exports and Hexgrad for the amazing project! None of this would be possible without you all! ๐ค
The model is also extremely resilient to quantization. The smallest variant is only 86 MB in size (down from the original 326 MB), with no noticeable difference in audio quality! ๐คฏ
-
- 11 replies
Post
8383
First project of 2025: Vision Transformer Explorer
I built a web app to interactively explore the self-attention maps produced by ViTs. This explains what the model is focusing on when making predictions, and provides insights into its inner workings! ๐คฏ
Try it out yourself! ๐
webml-community/attention-visualization
Source code: https://github.com/huggingface/transformers.js-examples/tree/main/attention-visualization
I built a web app to interactively explore the self-attention maps produced by ViTs. This explains what the model is focusing on when making predictions, and provides insights into its inner workings! ๐คฏ
Try it out yourself! ๐
webml-community/attention-visualization
Source code: https://github.com/huggingface/transformers.js-examples/tree/main/attention-visualization
Post
4279
Introducing Moonshine Web: real-time speech recognition running 100% locally in your browser!
๐ Faster and more accurate than Whisper
๐ Privacy-focused (no data leaves your device)
โก๏ธ WebGPU accelerated (w/ WASM fallback)
๐ฅ Powered by ONNX Runtime Web and Transformers.js
Demo: webml-community/moonshine-web
Source code: https://github.com/huggingface/transformers.js-examples/tree/main/moonshine-web
๐ Faster and more accurate than Whisper
๐ Privacy-focused (no data leaves your device)
โก๏ธ WebGPU accelerated (w/ WASM fallback)
๐ฅ Powered by ONNX Runtime Web and Transformers.js
Demo: webml-community/moonshine-web
Source code: https://github.com/huggingface/transformers.js-examples/tree/main/moonshine-web
-
- 5 replies
Post
3315
Introducing TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration! ๐ฅ High-quality and natural speech generation that runs 100% locally in your browser, powered by OuteTTS and Transformers.js. ๐ค Try it out yourself!
Demo: webml-community/text-to-speech-webgpu
Source code: https://github.com/huggingface/transformers.js-examples/tree/main/text-to-speech-webgpu
Model: onnx-community/OuteTTS-0.2-500M (ONNX), OuteAI/OuteTTS-0.2-500M (PyTorch)
Demo: webml-community/text-to-speech-webgpu
Source code: https://github.com/huggingface/transformers.js-examples/tree/main/text-to-speech-webgpu
Model: onnx-community/OuteTTS-0.2-500M (ONNX), OuteAI/OuteTTS-0.2-500M (PyTorch)
Post
4132
We just released Transformers.js v3.1 and you're not going to believe what's now possible in the browser w/ WebGPU! ๐คฏ Let's take a look:
๐ Janus from Deepseek for unified multimodal understanding and generation (Text-to-Image and Image-Text-to-Text)
๐๏ธ Qwen2-VL from Qwen for dynamic-resolution image understanding
๐ข JinaCLIP from Jina AI for general-purpose multilingual multimodal embeddings
๐ LLaVA-OneVision from ByteDance for Image-Text-to-Text generation
๐คธโโ๏ธ ViTPose for pose estimation
๐ MGP-STR for optical character recognition (OCR)
๐ PatchTST & PatchTSMixer for time series forecasting
That's right, everything running 100% locally in your browser (no data sent to a server)! ๐ฅ Huge for privacy!
Check out the release notes for more information. ๐
https://github.com/huggingface/transformers.js/releases/tag/3.1.0
Demo link (+ source code): webml-community/Janus-1.3B-WebGPU
๐ Janus from Deepseek for unified multimodal understanding and generation (Text-to-Image and Image-Text-to-Text)
๐๏ธ Qwen2-VL from Qwen for dynamic-resolution image understanding
๐ข JinaCLIP from Jina AI for general-purpose multilingual multimodal embeddings
๐ LLaVA-OneVision from ByteDance for Image-Text-to-Text generation
๐คธโโ๏ธ ViTPose for pose estimation
๐ MGP-STR for optical character recognition (OCR)
๐ PatchTST & PatchTSMixer for time series forecasting
That's right, everything running 100% locally in your browser (no data sent to a server)! ๐ฅ Huge for privacy!
Check out the release notes for more information. ๐
https://github.com/huggingface/transformers.js/releases/tag/3.1.0
Demo link (+ source code): webml-community/Janus-1.3B-WebGPU
Post
5810
Have you tried out ๐ค Transformers.js v3? Here are the new features:
โก WebGPU support (up to 100x faster than WASM)
๐ข New quantization formats (dtypes)
๐ 120 supported architectures in total
๐ 25 new example projects and templates
๐ค Over 1200 pre-converted models
๐ Node.js (ESM + CJS), Deno, and Bun compatibility
๐ก A new home on GitHub and NPM
Get started with
Learn more in our blog post: https://huggingface.co/blog/transformersjs-v3
โก WebGPU support (up to 100x faster than WASM)
๐ข New quantization formats (dtypes)
๐ 120 supported architectures in total
๐ 25 new example projects and templates
๐ค Over 1200 pre-converted models
๐ Node.js (ESM + CJS), Deno, and Bun compatibility
๐ก A new home on GitHub and NPM
Get started with
npm i @huggingface/transformers.Learn more in our blog post: https://huggingface.co/blog/transformersjs-v3
- 3 replies
Post
14039
I can't believe this... Phi-3.5-mini (3.8B) running in-browser at ~90 tokens/second on WebGPU w/ Transformers.js and ONNX Runtime Web! ๐คฏ Since everything runs 100% locally, no messages are sent to a server โ a huge win for privacy!
- ๐ค Demo: webml-community/phi-3.5-webgpu
- ๐งโ๐ป Source code: https://github.com/huggingface/transformers.js-examples/tree/main/phi-3.5-webgpu
- ๐ค Demo: webml-community/phi-3.5-webgpu
- ๐งโ๐ป Source code: https://github.com/huggingface/transformers.js-examples/tree/main/phi-3.5-webgpu
- 11 replies
Post
15090
I'm excited to announce that Transformers.js V3 is finally available on NPM! ๐ฅ State-of-the-art Machine Learning for the web, now with WebGPU support! ๐คฏโก๏ธ
Install it from NPM with:
๐๐๐ ๐ @๐๐๐๐๐๐๐๐๐๐๐/๐๐๐๐๐๐๐๐๐๐๐๐
or via CDN, for example: https://v2.scrimba.com/s0lmm0qh1q
Segment Anything demo: webml-community/segment-anything-webgpu
Install it from NPM with:
๐๐๐ ๐ @๐๐๐๐๐๐๐๐๐๐๐/๐๐๐๐๐๐๐๐๐๐๐๐
or via CDN, for example: https://v2.scrimba.com/s0lmm0qh1q
Segment Anything demo: webml-community/segment-anything-webgpu
- 5 replies
Post
8087
Introducing Whisper Diarization: Multilingual speech recognition with word-level timestamps and speaker segmentation, running 100% locally in your browser thanks to ๐ค Transformers.js!
Tested on this iconic Letterman interview w/ Grace Hopper from 1983!
- Demo: Xenova/whisper-speaker-diarization
- Source code: Xenova/whisper-speaker-diarization
Tested on this iconic Letterman interview w/ Grace Hopper from 1983!
- Demo: Xenova/whisper-speaker-diarization
- Source code: Xenova/whisper-speaker-diarization
- 1 reply
Post
6873
Introducing Whisper Timestamped: Multilingual speech recognition with word-level timestamps, running 100% locally in your browser thanks to ๐ค Transformers.js! Check it out!
๐ Xenova/whisper-word-level-timestamps ๐
This unlocks a world of possibilities for in-browser video editing! ๐คฏ What will you build? ๐
Source code: https://github.com/xenova/transformers.js/tree/v3/examples/whisper-word-timestamps
๐ Xenova/whisper-word-level-timestamps ๐
This unlocks a world of possibilities for in-browser video editing! ๐คฏ What will you build? ๐
Source code: https://github.com/xenova/transformers.js/tree/v3/examples/whisper-word-timestamps
- 1 reply
Post
6168
Chrome's new
We've also added experimental support to ๐ค Transformers.js!
- Demo: Xenova/experimental-built-in-ai-chat
- Blog post: https://huggingface.co/blog/Xenova/run-gemini-nano-in-your-browser
windowโ.ai feature is going to change the web forever! ๐คฏ It allows you to run Gemini Nano, a powerful 3.25B parameter LLM, 100% locally in your browser!We've also added experimental support to ๐ค Transformers.js!
- Demo: Xenova/experimental-built-in-ai-chat
- Blog post: https://huggingface.co/blog/Xenova/run-gemini-nano-in-your-browser
-
-
- 5 replies
Post
6083
Florence-2, the new vision foundation model by Microsoft, can now run 100% locally in your browser on WebGPU, thanks to Transformers.js! ๐ค๐คฏ
It supports tasks like image captioning, optical character recognition, object detection, and many more! ๐ WOW!
- Demo: Xenova/florence2-webgpu
- Models: https://huggingface.co/models?library=transformers.js&other=florence2
- Source code: https://github.com/xenova/transformers.js/tree/v3/examples/florence2-webgpu
It supports tasks like image captioning, optical character recognition, object detection, and many more! ๐ WOW!
- Demo: Xenova/florence2-webgpu
- Models: https://huggingface.co/models?library=transformers.js&other=florence2
- Source code: https://github.com/xenova/transformers.js/tree/v3/examples/florence2-webgpu
Post
10372
Introducing Whisper WebGPU: Blazingly-fast ML-powered speech recognition directly in your browser! ๐ It supports multilingual transcription and translation across 100 languages! ๐คฏ
The model runs locally, meaning no data leaves your device! ๐
Check it out! ๐
- Demo: Xenova/whisper-webgpu
- Source code: https://github.com/xenova/whisper-web/tree/experimental-webgpu
The model runs locally, meaning no data leaves your device! ๐
Check it out! ๐
- Demo: Xenova/whisper-webgpu
- Source code: https://github.com/xenova/whisper-web/tree/experimental-webgpu
- 7 replies
Post
11555
Introducing Phi-3 WebGPU, a private and powerful AI chatbot that runs 100% locally in your browser, powered by ๐ค Transformers.js and onnxruntime-web!
๐ On-device inference: no data sent to a server
โก๏ธ WebGPU-accelerated (> 20 t/s)
๐ฅ Model downloaded once and cached
Try it out: Xenova/experimental-phi3-webgpu
๐ On-device inference: no data sent to a server
โก๏ธ WebGPU-accelerated (> 20 t/s)
๐ฅ Model downloaded once and cached
Try it out: Xenova/experimental-phi3-webgpu
-
- 5 replies
Post
13031
Introducing MusicGen Web: AI-powered music generation directly in your browser, built with ๐ค Transformers.js! ๐ต
Everything runs 100% locally, meaning there are no calls to an API! ๐คฏ Since it's served as a static HF space, it costs $0 to host and run! ๐ฅ
We also added the ability to share your generated music to the discussion tab, so give it a try! ๐
Xenova/musicgen-web
Everything runs 100% locally, meaning there are no calls to an API! ๐คฏ Since it's served as a static HF space, it costs $0 to host and run! ๐ฅ
We also added the ability to share your generated music to the discussion tab, so give it a try! ๐
Xenova/musicgen-web
-
- 2 replies
Post
Introducing the ๐ค Transformers.js WebGPU Embedding Benchmark! โก๏ธ
๐ Xenova/webgpu-embedding-benchmark ๐
On my device, I was able to achieve a 64.04x speedup over WASM! ๐คฏ How much does WebGPU speed up ML models running locally in your browser? Try it out and share your results! ๐
๐ Xenova/webgpu-embedding-benchmark ๐
On my device, I was able to achieve a 64.04x speedup over WASM! ๐คฏ How much does WebGPU speed up ML models running locally in your browser? Try it out and share your results! ๐
- 3 replies
Post
Real-time object detection w/ ๐ค Transformers.js, running YOLOv9 locally in your browser! ๐คฏ
Try it out yourself: Xenova/video-object-detection
(Model used + example code: Xenova/gelan-c_all)
This demo shows why on-device ML is so important:
1. Privacy - local inference means no user data is sent to the cloud
2. No server latency - empowers developers to build real-time applications
3. Lower costs - no need to pay for bandwidth and processing of streamed video
I can't wait to see what you build with it! ๐ฅ
Try it out yourself: Xenova/video-object-detection
(Model used + example code: Xenova/gelan-c_all)
This demo shows why on-device ML is so important:
1. Privacy - local inference means no user data is sent to the cloud
2. No server latency - empowers developers to build real-time applications
3. Lower costs - no need to pay for bandwidth and processing of streamed video
I can't wait to see what you build with it! ๐ฅ
-
- 3 replies