Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tacotron2.decoder.infer behaves incorrectly #2511

Open
QuentinJGMace opened this issue Apr 16, 2024 · 2 comments
Open

Tacotron2.decoder.infer behaves incorrectly #2511

QuentinJGMace opened this issue Apr 16, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@QuentinJGMace
Copy link

Describe the bug

I tried to train a French Tacotron2 model. Given the samples taken from training, it went perfectly well.
However, when inferring after training using sb's usual pipeline, the mel output was white noise.

After investigating, the problem seems to be coming from the tacotron2 decoder when using decoder.infer. We manually loaded the weights and used the forward function instead and it worked like a charm.

Here are the mel spectrograms obtained by both functions (same weights used):
image
image

Expected behaviour

The mel outputs from the decoder.infer and decoder.forward functions should be the same.

To Reproduce

https://colab.research.google.com/drive/1KrOSM-cuiOQESVkPjpKO4_BFNNdyakuy?usp=sharing

Environment Details

No response

Relevant Log Output

No response

Additional Context

No response

@QuentinJGMace QuentinJGMace added the bug Something isn't working label Apr 16, 2024
@shankarsharma8089
Copy link

Hi @QuentinJGMace can i work on this issue

@QuentinJGMace
Copy link
Author

Hey @shankarsharma8089 , sure !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants