-
Notifications
You must be signed in to change notification settings - Fork 64
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Losing whole sentences when generating the wav file #49
Comments
That is a byproduct of the sentence splitter. It will just drop things here and there. The painful alternative is to do it sentence by sentence. An automated alternative would be to split the text beforehand (like by actual sentence) but, when it is phonemized it might miss parts of the audio at the end. Example: The old sentence splitter splits up until it hits the phoneme limit.
I edited mine to fit my need, and it seems to work out, but the text has to be in a very particular format (all lines end in ". ")
So it might introduce some abnormalities or behave unusually. |
interesting. I may give that a go. I dont think the developer is too bothered with this issue or is not able to replicate so been looking for a reliable alternative... not having any luck, so if this fixes it I will be very happy. |
This is happening when you use a finetuned model with some bad traing data. With the base 2.0.2 everthing works as expected. After manual curating all wav files and the whisper transcript, my finetuned models did not have that issue any more. Give it a try :) |
We are losing whole sentences or the end of sentences when we generate the audio. At first I thought it to be a training issue, but if you regenerate then you can get the sentence it missed last time back fine only for it to lose another one.
Here is an example of the text we are putting into it:
In the first gen it missed:
"Sammy, your destiny lies with the power of the Squawkstone." She was bewildered but excited by this revelation.
in the second gen it missed:
King Cluckington declared Sammy an honorary citizen of Fowlmore and bestowed upon her the title of "Chicken Whisperer."
The text was updated successfully, but these errors were encountered: