Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SCDF composed task execution for the automated tests #5761

Open
Setxand opened this issue Apr 4, 2024 · 2 comments
Open

SCDF composed task execution for the automated tests #5761

Setxand opened this issue Apr 4, 2024 · 2 comments
Labels
for/team-attention For team attention

Comments

@Setxand
Copy link

Setxand commented Apr 4, 2024

Hi, we have the automated tests project which is gonna run the composed task with up to 25 tasks inside. we're preparing very small amount of data and then run the SCDF's composed task, it works, but the creation of the up to 25 pods takes 20 mins, can I somehow decrease the execution time for the test purposes? Or it would be great to create the feature which executes every task in the composed one in one container to decrease the execution time

@github-actions github-actions bot added the status/need-triage Team needs to triage and take a first look label Apr 4, 2024
@cppwfs
Copy link
Contributor

cppwfs commented Apr 4, 2024

Thank you for the question.
I assume you are running things sequentially a && b && c && d
You could run tasks in parallel via a split execution <a || b> && <c || d> thus pods a and b are created and run at the same time and once both have successfully completed c and d would be created and run at the same time.
Just make sure you set the split-thread-core-pool-size property to the size of the largest number of tasks in the split execution.

@cppwfs cppwfs added status/need-feedback Calling participant to provide feedback and removed status/need-triage Team needs to triage and take a first look labels Apr 4, 2024
@Setxand
Copy link
Author

Setxand commented Apr 4, 2024

Thanks for the answer, i know i can do it, but unfortunately the tasks are dependent on each other that's why the execution order is important, so i guess there is no some kind of test mode, then It would be a cool feature to run the composed tasks in one container with the test mode flag

@github-actions github-actions bot added for/team-attention For team attention and removed status/need-feedback Calling participant to provide feedback labels Apr 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
for/team-attention For team attention
Projects
None yet
Development

No branches or pull requests

2 participants