kyutai
/

tts-voices

Model card Files Files and versions Community

lmz commited on 9 days ago

Commit

1fc7395

1 Parent(s): 3c1ed38

Upload folder using huggingface_hub

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

.gitattributes +24 -0
README.md +42 -0
cml-tts/fr/10087_11650_000028-0002.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/10177_10625_000134-0003.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/10179_11051_000005-0001.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/12080_11650_000047-0001.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/12205_11650_000004-0002.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/12977_10625_000037-0001.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/1406_1028_000009-0003.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/1591_1028_000108-0004.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/1770_1028_000036-0002.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/2114_1656_000053-0001.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/2154_2576_000020-0003.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/2216_1745_000007-0001.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/2223_1745_000009-0002.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/2465_1943_000152-0002.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/296_1028_000022-0001.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/3267_1902_000075-0001.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/4193_3103_000004-0001.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/4482_3103_000063-0001.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/4724_3731_000031-0001.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/4937_3731_000004-0001.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/5207_3078_000031-0002.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/5476_3103_000072-0001.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/577_394_000070-0001.wav +3 -0
cml-tts/fr/[email protected] +3 -0
cml-tts/fr/5790_4893_000052-0001.wav +3 -0
cml-tts/fr/[email protected] +3 -0

.gitattributes CHANGED Viewed

@@ -8,6 +8,8 @@
 *.h5 filter=lfs diff=lfs merge=lfs -text
 *.joblib filter=lfs diff=lfs merge=lfs -text
 *.lfs.* filter=lfs diff=lfs merge=lfs -text
 *.mlmodel filter=lfs diff=lfs merge=lfs -text
 *.model filter=lfs diff=lfs merge=lfs -text
 *.msgpack filter=lfs diff=lfs merge=lfs -text
@@ -33,3 +35,25 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text

 *.h5 filter=lfs diff=lfs merge=lfs -text
 *.joblib filter=lfs diff=lfs merge=lfs -text
 *.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.lz4 filter=lfs diff=lfs merge=lfs -text
+*.mds filter=lfs diff=lfs merge=lfs -text
 *.mlmodel filter=lfs diff=lfs merge=lfs -text
 *.model filter=lfs diff=lfs merge=lfs -text
 *.msgpack filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+# Audio files - uncompressed
+*.pcm filter=lfs diff=lfs merge=lfs -text
+*.sam filter=lfs diff=lfs merge=lfs -text
+*.raw filter=lfs diff=lfs merge=lfs -text
+# Audio files - compressed
+*.aac filter=lfs diff=lfs merge=lfs -text
+*.flac filter=lfs diff=lfs merge=lfs -text
+*.mp3 filter=lfs diff=lfs merge=lfs -text
+*.ogg filter=lfs diff=lfs merge=lfs -text
+*.wav filter=lfs diff=lfs merge=lfs -text
+# Image files - uncompressed
+*.bmp filter=lfs diff=lfs merge=lfs -text
+*.gif filter=lfs diff=lfs merge=lfs -text
+*.png filter=lfs diff=lfs merge=lfs -text
+*.tiff filter=lfs diff=lfs merge=lfs -text
+# Image files - compressed
+*.jpg filter=lfs diff=lfs merge=lfs -text
+*.jpeg filter=lfs diff=lfs merge=lfs -text
+*.webp filter=lfs diff=lfs merge=lfs -text
+# Video files - compressed
+*.mp4 filter=lfs diff=lfs merge=lfs -text
+*.webm filter=lfs diff=lfs merge=lfs -text

README.md ADDED Viewed

	@@ -0,0 +1,42 @@

+# Unmute voices
+## vctk/
+From the [Voice Cloning Toolkit](https://datashare.ed.ac.uk/handle/10283/3443) dataset,
+licensed under the Creative Commons License: Attribution 4.0 International.
+Each recording was done with two mics, here we used the `mic1` recordings.
+We chose sentence 23 for every speaker because it's generally the longest one to pronounce.
+## expresso/
+From the [Expresso](https://speechbot.github.io/expresso/) dataset,
+licensed under the Creative Commons License: Attribution-NonCommercial 4.0 International.
+**Non-commercial use only.**
+We select clips from the "conversational" files.
+For each pair of "kind" and channel (`ex04-ex01_laughing`, channel 1),
+we find one segment with at least 10 consecutive seconds of speech using `VAD_segments.txt`.
+We don't include more segments per (kind, channel) to keep the number of voices manageable.
+The name of the file indicates how it was selected.
+For instance, `ex03-ex02_narration_001_channel1_674s.wav`
+comes from the first audio channel of `audio_48khz/conversational/ex03-ex02/narration/ex03-ex02_narration_001.wav`,
+meaning it's speaker `ex03`.
+It's a 10-second clip starting at 674 seconds of the original file.
+## cml-tts/fr/
+French voices selected from the [CML-TTS Dataset](https://openslr.org/146/),
+licensed under the Creative Commons License: Attribution 4.0 International.
+## Computing voice embeddings (for Kyutai devs)
+```python
+uv run {root of `moshi` repo}/scripts/tts_make_voice.py \
+    --model-root {path to weights dir}/moshi_1e68beda_240/ \
+    --loudness-headroom 22 \
+    {root of this repo}
+```

cml-tts/fr/10087_11650_000028-0002.wav ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4bf06384d37a76a9bda02818d3051808091b807f329c5dfa76a74c89679d1b28
+size 347564