Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unconditional synthesis #2

Open
Rongjiehuang opened this issue Jul 23, 2022 · 1 comment
Open

unconditional synthesis #2

Rongjiehuang opened this issue Jul 23, 2022 · 1 comment

Comments

@Rongjiehuang
Copy link

Rongjiehuang commented Jul 23, 2022

Hi, thanks for sharing this code with the community. Before this, I tried several repos but failed to get reasonable sound in the SC09 dataset.

I am excited to generate waveforms with your provided checkpoint (model=wavenet model.res_channels=128 model.num_res_layers=30 model.dilation_cycle=10 train.batch_size_per_gpu=4) and get samples. However, when I conduct testing following this, I fail to reproduce the objective evaluation results in the original diffwave paper (mIS: 5 vs. 59), and some items are noisy.

Have you ever met with this issue? and Could you recommend a code base for unconditional waveform synthesis? Thanks!

@albertfgu
Copy link
Owner

That command corresponds to the small DiffWave(+WaveNet) model, which is not supposed to sound great. Instructions for the base model are in the README. Our paper reports mIS ~9 for the small model and ~51 for the base model (Table 7).

I'm not aware of another codebase that has good unconditional SC09 synthesis.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants