Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Display Val images per class #12645

Merged
merged 33 commits into from
May 29, 2024
Merged

Display Val images per class #12645

merged 33 commits into from
May 29, 2024

Conversation

sunmooncode
Copy link
Contributor

@sunmooncode sunmooncode commented May 13, 2024

Add a new parameter for users to choose from in the detected val script. The function of this parameter is to control the output method of images in the val result.

For more details please refer to here!

πŸ› οΈ PR Summary

Made with ❀️ by Ultralytics Actions

🌟 Summary

Enhanced tracking of object detection, pose estimation, and segmentation metrics in YOLO models. πŸ“ˆ

πŸ“Š Key Changes

  • CI Configuration: Removed a redundant line setting slow dependencies, ensuring dependencies are now conditionally installed based on the event that triggers the workflow. 🧹
  • Detection, Pose, and Segmentation: Introduced tracking of unique images alongside class and prediction statistics to improve metric accuracy and reporting. πŸ–ΌοΈ
  • Metric Reporting: Enhanced metric reporting to include per-image statistics in addition to per-class statistics for deeper insights. This involves changes to logging and the calculation of nt_per_class and the newly added nt_per_image. πŸ“Š

🎯 Purpose & Impact

  • Better Dependency Management: The update in CI configuration tidies up the dependency installation process, making the CI runs more efficient and less prone to errors. πŸ› οΈ
  • Improved Accuracy & Insights: Adding nt_per_image allows developers and users to gain a clearer understanding of model performance on a per-image basis. This can lead to better-targeted improvements and more detailed performance analysis. πŸ”
  • Enhanced User Awareness: By including additional logging details, users can now receive a more granular breakdown of how the model is performing across different classes and images, enriching the user experience and aiding in debugging and model optimization. πŸš€

Copy link

codecov bot commented May 13, 2024

Codecov Report

All modified and coverable lines are covered by tests βœ…

Project coverage is 70.16%. Comparing base (b95b583) to head (f235c0e).

Additional details and impacted files
@@            Coverage Diff             @@
##             main   #12645      +/-   ##
==========================================
- Coverage   71.01%   70.16%   -0.86%     
==========================================
  Files         124      124              
  Lines       15658    15664       +6     
==========================================
- Hits        11119    10990     -129     
- Misses       4539     4674     +135     
Flag Coverage Ξ”
Benchmarks 35.31% <90.90%> (-0.18%) ⬇️
GPU 37.26% <63.63%> (+0.01%) ⬆️
Tests 66.31% <100.00%> (-0.81%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

β˜” View full report in Codecov by Sentry.
πŸ“’ Have feedback on the report? Share it here.

@Burhan-Q Burhan-Q added the enhancement New feature or request label May 13, 2024
@Burhan-Q Burhan-Q linked an issue May 13, 2024 that may be closed by this pull request
2 tasks
@glenn-jocher
Copy link
Member

@sunmooncode hey great, this looks like a nice improvement. Once change is that can you please remove the argument so we use this change by default? Thanks!

@sunmooncode
Copy link
Contributor Author

I deleted the optional parameter and used it by default.

@glenn-jocher
Copy link
Member

That sounds great, @sunmooncode! Making the feature default simplifies the usage while providing enhanced insights consistently. Thanks for your contribution! πŸš€ If anything else needs to be adjusted, feel free to let us know.

@glenn-jocher glenn-jocher changed the title Better evaluation results show! Enhanced Val mode with unique images May 17, 2024
@glenn-jocher glenn-jocher changed the title Enhanced Val mode with unique images Enhanced Validation displays unique images May 17, 2024
@glenn-jocher glenn-jocher added the TODO Items that needs completing label May 17, 2024
@glenn-jocher
Copy link
Member

@sunmooncode can you please delete the detail_per_class: False # (bool) detailed per-class results argument entirely and we'll use this as the new default? Thank you!

@sunmooncode
Copy link
Contributor Author

@glenn-jocher Of course. Please wait for me for a moment.

@glenn-jocher
Copy link
Member

Sure thing, @sunmooncode! Take your time. 😊

@glenn-jocher glenn-jocher changed the title Enhanced Validation displays unique images Display Val images per class May 29, 2024
@glenn-jocher glenn-jocher merged commit 7cd871d into ultralytics:main May 29, 2024
15 checks passed
@glenn-jocher
Copy link
Member

@sunmooncode PR merged! Thank you for your contributions :)

@glenn-jocher glenn-jocher removed the TODO Items that needs completing label May 29, 2024
gkinman pushed a commit to Octasic/ultralytics that referenced this pull request May 30, 2024
Co-authored-by: UltralyticsAssistant <web@ultralytics.com>
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Better evaluation results show.
4 participants