Real-Time Voice Cloning in Spanish

This repository is a fork of Real Time Voice Cloning (RTVC) with a synthesizer that works for the Spanish language. You can check my paper for a more detailed explanation. You can listen to the demo audios from all the Spanish models we trained (and a sample from RacoonML's trained model, too) here.

Papers implemented (by CorentinJ)

URL	Designation	Title	Implementation source
1806.04558	SV2TTS	Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis	This repo
1802.08435	WaveRNN (vocoder)	Efficient Neural Audio Synthesis	fatchord/WaveRNN
1703.10135	Tacotron (synthesizer)	Tacotron: Towards End-to-End Speech Synthesis	fatchord/WaveRNN
1710.10467	GE2E (encoder)	Generalized End-To-End Loss for Speaker Verification	This repo

Dataset used

Mozilla's Common Voice Spanish dataset

Setup

1. Install Requirements

1. Both Windows and Linux are supported. A GPU is recommended for training and for inference speed, but is not mandatory.
2. Python 3.7 is recommended. Python 3.5 or greater should work, but you'll probably have to tweak the dependencies' versions. I recommend setting up a virtual environment using venv, but this is optional.
3. Install ffmpeg. This is necessary for reading audio files.
4. Install PyTorch. Pick the latest stable version, your operating system, your package manager (pip by default) and finally pick any of the proposed CUDA versions if you have a GPU, otherwise pick CPU. Run the given command.
5. Install the remaining requirements with pip install -r requirements.txt

Python 3.6 or 3.7 is needed to run the toolbox.

• Install PyTorch (>=1.1.0).
• Install ffmpeg.
• Run pip install -r requirements.txt to install the remaining necessary packages.

2. Download Pretrained Models

Download the latest here.

3. Try the demo CLI

python demo_cli.py

If all tests pass, you're good to go.

4. Launch the Toolbox

You can then try the toolbox: python demo_toolbox.py