SmolVLM: Redefining small and efficient multimodal models
Paper
•
2504.05299
•
Published
•
158
kmhf
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
kmhf's activity
pcuenq
authored
a
paper
7 days ago
reach-vb
authored
a
paper
7 days ago
freddyaboulton
posted
an
update
21 days ago
Post
1461
Ever wanted to share your AI creations with friends? ✨
Screenshots are fine, but imagine letting others play with your ACTUAL model!
Introducing Gradio deep links 🔗 - now you can share interactive AI apps, not just images.
Add a gr.DeepLinkButton to any app and get shareable URLs that let ANYONE experiment with your models.
Screenshots are fine, but imagine letting others play with your ACTUAL model!
Introducing Gradio deep links 🔗 - now you can share interactive AI apps, not just images.
Add a gr.DeepLinkButton to any app and get shareable URLs that let ANYONE experiment with your models.
freddyaboulton
posted
an
update
about 1 month ago
Post
1925
Privacy matters when talking to AI! 🔇
We've just added a microphone mute button to FastRTC in our latest update (v0.0.14). Now you control exactly what your LLM hears.
Plus lots more features in this release! Check them out:
https://github.com/freddyaboulton/fastrtc/releases/tag/0.0.14
We've just added a microphone mute button to FastRTC in our latest update (v0.0.14). Now you control exactly what your LLM hears.
Plus lots more features in this release! Check them out:
https://github.com/freddyaboulton/fastrtc/releases/tag/0.0.14
Post
3247
Important notice 🚨
For Inference Providers who have built support for our Billing API (currently: Fal, Novita, HF-Inference – with more coming soon), we've started enabling Pay as you go (=PAYG)
What this means is that you can use those Inference Providers beyond the free included credits, and they're charged to your HF account.
You can see it on this view: any provider that does not have a "Billing disabled" badge, is PAYG-compatible.
For Inference Providers who have built support for our Billing API (currently: Fal, Novita, HF-Inference – with more coming soon), we've started enabling Pay as you go (=PAYG)
What this means is that you can use those Inference Providers beyond the free included credits, and they're charged to your HF account.
You can see it on this view: any provider that does not have a "Billing disabled" badge, is PAYG-compatible.
- 7 replies
freddyaboulton
posted
an
update
about 2 months ago
Post
3237
Getting WebRTC and Websockets right in python is very tricky. If you've tried to wrap an LLM in a real-time audio layer then you know what I'm talking about.
That's where FastRTC comes in! It makes WebRTC and Websocket streams super easy with minimal code and overhead.
Check out our org: hf.co/fastrtc
That's where FastRTC comes in! It makes WebRTC and Websocket streams super easy with minimal code and overhead.
Check out our org: hf.co/fastrtc
Post
6270
SmolVLM-2 and SigLIP-2 are now part of
They're added on top of the v4.49.0 release, and can be installed from the following tags:
This marks a new beginning for the release process of transformers. For the past five years, we've been doing monthly releases featuring many models (v4.49.0, the latest release, features 9 new architectures).
Starting with SmolVLM-2 & SigLIP2, we'll now additionally release tags supporting new models on a stable branch. These models are therefore directly available for use by installing from the tag itself. These tags will continue to be updated with fixes applied to these models.
Going forward, continue expecting software releases following semantic versioning: v4.50.0 will have ~10 new architectures compared to v4.49.0, as well as a myriad of new features, improvements and bug fixes. Accompanying these software releases, we'll release tags offering brand new models as fast as possible, to make them accessible to all immediately.
transformers in dedicated releases!They're added on top of the v4.49.0 release, and can be installed from the following tags:
v4.49.0-SmolVLM-2 and v4.49.0-SigLIP-2.This marks a new beginning for the release process of transformers. For the past five years, we've been doing monthly releases featuring many models (v4.49.0, the latest release, features 9 new architectures).
Starting with SmolVLM-2 & SigLIP2, we'll now additionally release tags supporting new models on a stable branch. These models are therefore directly available for use by installing from the tag itself. These tags will continue to be updated with fixes applied to these models.
Going forward, continue expecting software releases following semantic versioning: v4.50.0 will have ~10 new architectures compared to v4.49.0, as well as a myriad of new features, improvements and bug fixes. Accompanying these software releases, we'll release tags offering brand new models as fast as possible, to make them accessible to all immediately.
-
- 1 reply
lmz
authored
a
paper
2 months ago
reach-vb
authored
a
paper
2 months ago
adefossez
updated
a
model
2 months ago
adefossez
published
a
model
2 months ago
adefossez
updated
a
model
2 months ago
lmz
updated
2
models
2 months ago
adefossez
published
a
model
2 months ago
lmz
updated
a
Space
2 months ago
freddyaboulton
posted
an
update
4 months ago
Post
1803
Just created a Gradio space for playing with the new OAI realtime voice API!
freddyaboulton/openai-realtime-voice
freddyaboulton/openai-realtime-voice
jbilcke-hf
posted
an
update
4 months ago
Post
12232
Doing some testing with HunyuanVideo on the Hugging Face Inference Endpoints 🤗
prompt: "a Shiba Inu is acting as a DJ, he wears sunglasses and is mixing and scratching with vinyl discs at a Ibiza sunny sand beach party"
1280x720, 22 steps, 121 frames
There are still some things to iron out regarding speed and memory usage, right now it takes 20min on an A100 (see attached charts)
but you can check it out here:
https://huggingface.co/jbilcke-hf/HunyuanVideo-for-InferenceEndpoints
There are various things I want to try like the 100% diffusers version and other models (LTX-Video..)
prompt: "a Shiba Inu is acting as a DJ, he wears sunglasses and is mixing and scratching with vinyl discs at a Ibiza sunny sand beach party"
1280x720, 22 steps, 121 frames
There are still some things to iron out regarding speed and memory usage, right now it takes 20min on an A100 (see attached charts)
but you can check it out here:
https://huggingface.co/jbilcke-hf/HunyuanVideo-for-InferenceEndpoints
There are various things I want to try like the 100% diffusers version and other models (LTX-Video..)
freddyaboulton
posted
an
update
4 months ago
Post
995
Gemini can talk 🗣️
Check out the new multimodal API from Google on @akhaliq 's anychat or my space. It's very fast and smart 🍓
https://huggingface.co/spaces/freddyaboulton/gemini-voicehttps://huggingface.co/spaces/akhaliq/anychat
Check out the new multimodal API from Google on @akhaliq 's anychat or my space. It's very fast and smart 🍓
https://huggingface.co/spaces/freddyaboulton/gemini-voicehttps://huggingface.co/spaces/akhaliq/anychat
- 1 reply
freddyaboulton
posted
an
update
4 months ago
Post
2434
Version 0.0.21 of gradio-pdf now properly loads chinese characters!