|
|
--- |
|
|
license: mit |
|
|
language: |
|
|
- en |
|
|
base_model: |
|
|
- yl4579/StyleTTS2-LibriTTS |
|
|
pipeline_tag: text-to-speech |
|
|
--- |
|
|
|
|
|
# StyleTTS 2 - lite |
|
|
|
|
|
## Online Demo |
|
|
Explore the model on Hugging Face Spaces: |
|
|
https://huggingface.co/spaces/dangtr0408/StyleTTS2-lite-space |
|
|
|
|
|
## Fine-tune |
|
|
https://github.com/dangtr0408/StyleTTS2-lite |
|
|
|
|
|
## Training Details |
|
|
|
|
|
1. **Base Checkpoint:** Initialized from the official StyleTTS 2 weights pre-trained on LibriTTS. |
|
|
2. **Components Removal:** PLBert, Diffusion, Prosodic Encoder, SLM, and Spectral Normalization. |
|
|
2. **Training Data:** LibriTTS corpus. |
|
|
3. **Training Schedule:** Trained for 100,000 steps. |
|
|
|
|
|
## Model Architecture |
|
|
|
|
|
| Component | Parameters | |
|
|
| -------------- | ------------- | |
|
|
| Decoder | 54 ,289 ,492 | |
|
|
| Predictor | 16 ,194 ,612 | |
|
|
| Style Encoder | 13 ,845 ,440 | |
|
|
| Text Encoder | 5,612 ,320 | |
|
|
| **Total** | **89 ,941 ,576** | |
|
|
|
|
|
## Prerequisites |
|
|
|
|
|
- **Python:** Version 3.7 or higher |
|
|
- **Git:** To clone the repository |
|
|
|
|
|
## Installation & Setup |
|
|
|
|
|
1. Clone the repository |
|
|
|
|
|
```bash |
|
|
|
|
|
git clone https://huggingface.co/dangtr0408/StyleTTS2-lite |
|
|
|
|
|
cd StyleTTS2-lite |
|
|
|
|
|
``` |
|
|
|
|
|
2. Install dependencies: |
|
|
|
|
|
```bash |
|
|
|
|
|
pip install -r requirements.txt |
|
|
|
|
|
``` |
|
|
|
|
|
|
|
|
|
|
|
3. On **Linux**, manually install espeak: |
|
|
|
|
|
```bash |
|
|
|
|
|
sudo apt-get install espeak-ng |
|
|
|
|
|
``` |
|
|
|
|
|
## Usage Example |
|
|
|
|
|
See run.ipynb file. |
|
|
|
|
|
## Disclaimer |
|
|
|
|
|
**Before using these pre-trained models, you agree to inform the listeners that the speech samples are synthesized by the pre-trained models, unless you have the permission to use the voice you synthesize. That is, you agree to only use voices whose speakers grant the permission to have their voice cloned, either directly or by license before making synthesized voices public, or you have to publicly announce that these voices are synthesized if you do not have the permission to use these voices.** |
|
|
|
|
|
|
|
|
## References |
|
|
|
|
|
- [yl4579/StyleTTS2](https://arxiv.org/abs/2306.07691) |
|
|
|
|
|
- [jik876/hifi-gan](https://github.com/jik876/hifi-gan) |
|
|
|
|
|
## License |
|
|
|
|
|
**Code: MIT License** |
