Rust Sun's picture
4 21

Rust Sun

vigos

AI & ML interests

None yet

Recent Activity

liked a Space 27 days ago
mrfakename/E2-F5-TTS
liked a Space 28 days ago
galileo-ai/agent-leaderboard
updated a Space 28 days ago
vigos/First_agent_template
View all activity

Organizations

Hugging Face Discord Community's profile picture

vigos's activity

upvoted an article 5 months ago
view article
Article

How to build a custom text classifier without days of human labeling

By sdiazlor and 4 others
55
reacted to reach-vb's post with 👍 5 months ago
view post
Post
5540
Multimodal Ichigo Llama 3.1 - Real Time Voice AI 🔥

> WhisperSpeech X Llama 3.1 8B
> Trained on 50K hours of speech (7 languages)
> Continually trained on 45hrs 10x A1000s
> MLS -> WhisperVQ tokens -> Llama 3.1
> Instruction tuned on 1.89M samples
> 70% speech, 20% transcription, 10% text
> Apache 2.0 licensed ⚡

Architecture:
> WhisperSpeech/ VQ for Semantic Tokens
> Llama 3.1 8B Instruct for Text backbone
> Early fusion (Chameleon)

I'm super bullish on HomeBrew/ Jan and early fusion, audio and text, multimodal models!

(P.S. Play with the demo on Hugging Face: jan-hq/Ichigo-llama3.1-s-instruct)