File size: 2,631 Bytes
8dec2ab c88d036 8dec2ab c88d036 8dec2ab c88d036 8dec2ab c88d036 5fcb75d c88d036 8dec2ab c88d036 8dec2ab c88d036 8dec2ab 2db5c30 8dec2ab c88d036 8dec2ab c88d036 8dec2ab c88d036 8dec2ab c88d036 8dec2ab c88d036 8dec2ab c88d036 8dec2ab c88d036 8dec2ab c88d036 8dec2ab c88d036 5fcb75d c88d036 8dec2ab c88d036 8dec2ab c88d036 8dec2ab c88d036 8dec2ab c88d036 8dec2ab c88d036 8dec2ab |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 |
---
license: mit
datasets:
- capleaf/viVoice
language:
- vi
- en
base_model:
- yl4579/StyleTTS2-LibriTTS
pipeline_tag: text-to-speech
---
# StyleTTS 2 - lite
> A lightweight, efficient variation of the StyleTTS 2 text‐to‐speech model, optimized for rapid integration into your applications. With a compact 90 million parameter footprint and built‐in speaker‑and‑language tagging, you can seamlessly switch voices and languages even within a single sentence.
## Online Demo
Explore the model on Hugging Face Spaces:
https://huggingface.co/spaces/dangtr0408/StyleTTS2-lite-vi-space
## Fine-tune
https://github.com/dangtr0408/StyleTTS2-lite
## Training Details
1. **Base Checkpoint:**
- Initialized from the official StyleTTS 2 LibriTTS weights.
2. **Token Extension:**
- Expanded the token set to 189 symbols to ensure full Vietnamese IPA compatibility.
3. **Training Data:**
- **FonosVietnam** (extracted from the viVoice corpus)
- **VoizFM** (extracted from the viVoice corpus)
4. **Training Schedule:**
- Trained for 120 000 steps.
## Model Architecture
| Component | Parameters |
| -------------- | ------------- |
| Decoder | 54 ,289 ,492 |
| Predictor | 16 ,194 ,612 |
| Style Encoder | 13 ,845 ,440 |
| Text Encoder | 5,612 ,320 |
| **Total** | **89 ,941 ,576** |
## Prerequisites
- **Python:** Version 3.7 or higher
- **Git:** To clone the repository
## Installation & Setup
1. Clone the repository
```bash
git clone https://huggingface.co/dangtr0408/StyleTTS2-lite-vi
cd StyleTTS2-lite-vi
```
2. Install dependencies:
```bash
pip install -r requirements.txt
```
3. On **Linux**, manually install espeak:
```bash
sudo apt-get install espeak-ng
```
## Usage Example
See run.ipynb file.
## Disclaimer
***Before using these pre-trained models, you agree to inform the listeners that the speech samples are synthesized by the pre-trained models, unless you have the permission to use the voice you synthesize. That is, you agree to only use voices whose speakers grant the permission to have their voice cloned, either directly or by license before making synthesized voices public, or you have to publicly announce that these voices are synthesized if you do not have the permission to use these voices.***
## References
- [yl4579/StyleTTS2](https://arxiv.org/abs/2306.07691)
- [jik876/hifi-gan](https://github.com/jik876/hifi-gan)
- [capleaf/viVoice](https://huggingface.co/datasets/capleaf/viVoice)
## License
**Code: MIT License**
**Model: CC-BY-NC-SA-4.0** |