Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

weird pulse at the end of the model #216

Open
matmult opened this issue Mar 14, 2024 · 2 comments
Open

weird pulse at the end of the model #216

matmult opened this issue Mar 14, 2024 · 2 comments

Comments

@matmult
Copy link

matmult commented Mar 14, 2024

As titled, there are a lot of comments in the code that says "weird pulse at the end of the model". I would just like to know if this has been fixed.

@Ziyueyork
Copy link

I use whisper-large-v3 for adversarial training instead of wav-lm. The pulse disappeared after finetune. Hope it helps.

@mocialov
Copy link

mocialov commented May 28, 2024

@Ziyueyork I have tried train_finetune.py with slm: model: 'openai/whisper-large-v3', but I get Whisper expects the mel input features to be of length 3000, but found 20000. Make sure to pad the input mel features to 3000. Do you have a suggestion as to how to get to the right shape? I use max_len: 100

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants