After 4000 votes F5 TTS fell near the bottom of the leaderboard, I extracted some sample from Emilia. Let us see if that changes anything.
Yanis L PRO
Pendrokar
AI & ML interests
STT/STS/TTS you know, something that is solveable
Recent Activity
updated
a dataset
6 minutes ago
Pendrokar/TTS_Arena
updated
a dataset
11 minutes ago
Pendrokar/TTS_Arena
updated
a dataset
16 minutes ago
Pendrokar/TTS_Arena
Organizations
Pendrokar's activity
replied to
their
post
2 days ago
reacted to
dylanebert's
post with 🤗
7 days ago
Post
1755
🟦 New Image-to-3D model from Stability AI
stabilityai/stable-point-aware-3d
here's how it looks, with TRELLIS for comparison
stabilityai/stable-point-aware-3d
here's how it looks, with TRELLIS for comparison
reacted to
hexgrad's
post with 🔥
12 days ago
Post
14853
📣 Looking for labeled, high-quality synthetic audio/TTS data 📣 Have you been or are you currently calling API endpoints from OpenAI, ElevenLabs, etc? Do you have labeled audio data sitting around gathering dust? Let's talk! Join https://discord.gg/QuGxSWBfQy or comment down below.
If your data exceeds quantity & quality thresholds and is approved into the next hexgrad/Kokoro-82M training mix, and you permissively DM me the data under an effective Apache license, then I will DM back the corresponding voicepacks for YOUR data if/when the next Apache-licensed Kokoro base model drops.
What does this mean? If you've been calling closed-source TTS or audio API endpoints to:
- Build voice agents
- Make long-form audio, like audiobooks or podcasts
- Handle customer support, etc
Then YOU can contribute to the training mix and get useful artifacts in return. ❤️
More details at hexgrad/Kokoro-82M#21
If your data exceeds quantity & quality thresholds and is approved into the next hexgrad/Kokoro-82M training mix, and you permissively DM me the data under an effective Apache license, then I will DM back the corresponding voicepacks for YOUR data if/when the next Apache-licensed Kokoro base model drops.
What does this mean? If you've been calling closed-source TTS or audio API endpoints to:
- Build voice agents
- Make long-form audio, like audiobooks or podcasts
- Handle customer support, etc
Then YOU can contribute to the training mix and get useful artifacts in return. ❤️
More details at hexgrad/Kokoro-82M#21
- 19 replies
The original Arena's threshold is at 700 votes. But I am sure Kokoro will hold the position. The voice quality actually sounds close to ElevenLabs.
But StyleTTS usually is not very emotional. So it will fail where Edge TTS does. The phrases where the voice has to be sad or angry. For example Parler Expresso was overly jolly.
reacted to
hexgrad's
post with 🔥
about 2 months ago
Post
2982
self.brag(): Kokoro finally got 300 votes in
Pendrokar/TTS-Spaces-Arena after
@Pendrokar
was kind enough to add it 3 weeks ago.Discounting the small sample size of votes, I think it is safe to say that hexgrad/Kokoro-TTS is currently a top 3 model among the contenders in that Arena. This is notable because:
- At 82M params, Kokoro is one of the smaller models in the Arena
- MeloTTS has 52M params
- F5 TTS has 330M params
- XTTSv2 has 467M params
-
-
- 5 replies
reacted to
hexgrad's
post with 👍
about 2 months ago
Post
1396
@Respair
just dropped Tsukasa: frontier TTS in Japanese
Respair/Tsukasa_Speech
It's expressive, punches way above its weight class, and supports voice cloning. Go check it out! 🚀
(Unmute the audio sample below after hitting play)
It's expressive, punches way above its weight class, and supports voice cloning. Go check it out! 🚀
(Unmute the audio sample below after hitting play)
replied to
their
post
about 2 months ago
True, a sample from the original dataset would probably be the best. My attempt to try to fetch one from Emilia dataset was unsuccessful as HF dataset viewer can only show the German samples. Emilia's homepage has a ASMR-y example prompt given.
replied to
their
post
about 2 months ago
True about the narration style sample, but that still did not stop XTTS in surpassing F5. Both use the same sample.
posted
an
update
about 2 months ago
Post
638
TTS: Sorry, I just cannot get the hype behind F5 TTS. It has now gathered a thousand votes in the TTS Arena fork and **has remained in #8 spot** against the _mostly_ Open TTS adversaries.
The voice sample used is the same as XTTS. F5 has so far been unstable, being unemotional/monotone/depressed and mispronouncing words (_awestruck_).
If you have suggestions please give feedback in the following thread:
mrfakename/E2-F5-TTS#32
The voice sample used is the same as XTTS. F5 has so far been unstable, being unemotional/monotone/depressed and mispronouncing words (_awestruck_).
If you have suggestions please give feedback in the following thread:
mrfakename/E2-F5-TTS#32
-
-
- 6 replies
reacted to
hexgrad's
post with 🔥
2 months ago
Post
3279
Kokoro: a small, fast 80M param TTS model hosted on ZeroGPU at
hexgrad/Kokoro-TTS
- 3 replies
posted
an
update
2 months ago
Post
1167
Added
@amphion
MaskGCT &
@hexgrad
StyleTTS fine tuned model by the name of kokoro to the forked TTS Arena Space. If things keep up from what is seen in the preliminary results, then these two may end up in the TOP 5 of all TTS models. 🤞️🍀️
Pendrokar/TTS-Spaces-Arena
Svngoku/maskgct-audio-lab
hexgrad/Kokoro-TTS
I chose @Svngoku 's forked HF space over amphion's due to the overly high ZeroGPU duration demand on the latter. 300s!
amphion/maskgct
Had to remove @mrfakename 's MetaVoice-1B Space from the available models as that space has been down for quite some time. 🤕️
mrfakename/MetaVoice-1B-v0.1
I'm close to syncing the code to the original Arena's code structure. Then I'd like to use ASR in order to validate and create synthetic public datasets from the generated samples. And then make the Arena multilingual, which will surely attract quite the crowd!
Pendrokar/TTS-Spaces-Arena
Svngoku/maskgct-audio-lab
hexgrad/Kokoro-TTS
I chose @Svngoku 's forked HF space over amphion's due to the overly high ZeroGPU duration demand on the latter. 300s!
amphion/maskgct
Had to remove @mrfakename 's MetaVoice-1B Space from the available models as that space has been down for quite some time. 🤕️
mrfakename/MetaVoice-1B-v0.1
I'm close to syncing the code to the original Arena's code structure. Then I'd like to use ASR in order to validate and create synthetic public datasets from the generated samples. And then make the Arena multilingual, which will surely attract quite the crowd!
- 1 reply
reacted to
mrfakename's
post with 👍
3 months ago
Post
6965
I just released an unofficial demo for Moonshine ASR!
Moonshine is a fast, efficient, & accurate ASR model released by Useful Sensors. It's designed for on-device inference and licensed under the MIT license!
HF Space (unofficial demo): mrfakename/Moonshine
GitHub repo for Moonshine: https://github.com/usefulsensors/moonshine
Moonshine is a fast, efficient, & accurate ASR model released by Useful Sensors. It's designed for on-device inference and licensed under the MIT license!
HF Space (unofficial demo): mrfakename/Moonshine
GitHub repo for Moonshine: https://github.com/usefulsensors/moonshine
replied to
their
post
3 months ago
TTS-AGI/TTS-Arena's button for downloading the DB data was available for a short while. The reason for removal must have been the unreviewed user submitted entries within the spokentext table. I've cleaned it up:
https://huggingface.co/datasets/Pendrokar/TTS_Arena_DB
replied to
their
post
3 months ago
Link to Spaces fork: https://huggingface.co/spaces/Pendrokar/TTS-Spaces-Arena
Link to Original Arena: https://huggingface.co/spaces/TTS-AGI/TTS-Arena
posted
an
update
3 months ago
Post
640
How the 🗣🏆 leaderboard of a merged TTS Arena with the 🤗 Spaces fork would look like. These results are somewhat unreliable as some models have not challenged the other in the list. And the original TTS Arena used only narration type sentences.
-
- 2 replies
posted
an
update
3 months ago
Post
1384
Made a notable change to the TTS Arena fork. I do not think anyone is interested in which bottomfeeder TTS is better than another beside it. So one of the top 5 TTS is always chosen in a challenge for more scrutiny. Also these top 5 are taken from preliminary results.
Pendrokar/TTS-Spaces-Arena
Pendrokar/TTS-Spaces-Arena
reacted to
mrfakename's
post with 👍
8 months ago
Post
10878
Introducing StyleTTS 2 detector, an audio classification model to detect StyleTTS 2 vs human-generated content!
Dual-licensed under MIT/Apache 2.0.
Model Weights: mrfakename/styletts2-detector
Spaces: mrfakename/styletts2-detector
Dual-licensed under MIT/Apache 2.0.
Model Weights: mrfakename/styletts2-detector
Spaces: mrfakename/styletts2-detector
- 2 replies