Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Reduce build matrix size #292

Draft
wants to merge 17 commits into
base: master
Choose a base branch
from

Conversation

kennylevinsen
Copy link
Contributor

@kennylevinsen kennylevinsen commented Nov 22, 2023

Significantly reduce the build matrix size for simpler results and less build scheduling latency. Drops multi-compiler tests.

Based on the 0.17 update branch because of a minor conflict it will create.

@joggee-fr
Copy link
Collaborator

I don't understand why it is an issue to test multiple compilers with CI. It seems on the contrary a good test to do.

@kennylevinsen
Copy link
Contributor Author

Minor rant about test strategies:

Adding anything possible is not a good test strategy, and more tests are not itself better than fewer as they are a liability and add noise (the more indicators, the less each one means), test time (either per run or in scheduling and full test completion), and maintenance (minor here, but still a factor) that should be justified. Focus should be on adding tests that are expected to add value and cover new areas or known problem areas.

Testing clang vs. gcc tells us very little. It does not test for distro or OS build environment compatibility, as each OS and distro use different compiler versions, library versions and configurations. With that in mind it just seemed like noise to me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants