Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Saving Augmented Images #12993

Open
1 task done
BehdadSDP opened this issue May 9, 2024 · 1 comment
Open
1 task done

Saving Augmented Images #12993

BehdadSDP opened this issue May 9, 2024 · 1 comment
Labels
question Further information is requested

Comments

@BehdadSDP
Copy link

Search before asking

Question

Hello friends,
"As you know, data augmentation methods lead to a slower training process. Therefore, I have decided to perform augmentation methods once and save the new images. Then, for another training process, I will only use these new images and will not use augmentation methods in the training process. In the getitem method of the LoadImagesAndLabels class, I saved the images and their corresponding labels. To achieve this, I used one epoch with a batch size of one to perform these methods for each image. After the process was finished, I checked the images and labels, and everything is fine. However, the problem is that I can't achieve the same accuracy as before with this new dataset (augmented method)."

Additional

No response

@BehdadSDP BehdadSDP added the question Further information is requested label May 9, 2024
@glenn-jocher
Copy link
Member

Hello!

It sounds like you've implemented a smart strategy for handling data augmentations! However, when you pre-generate and save augmented images as static datasets, there could be a loss in the variability and randomness that on-the-fly augmentations provide during training, potentially impacting the model's ability to generalize well.

It's important to ensure that your static dataset has sufficient diversity and coverage of possible variations. Consider also integrating a mix of augmented and original images in your training batches to maintain some level of randomness.

If accuracy continues to be an issue, reviewing the types of augmentations and their parameters might help. Sometimes, excessive or improperly tuned augmentations can distort the learning process rather than aiding it.

Keep up the experimentation! 🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants