Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Collection runner parallelism should be optional #2251

Open
1 task done
MelGrubb opened this issue May 6, 2024 · 1 comment
Open
1 task done

Collection runner parallelism should be optional #2251

MelGrubb opened this issue May 6, 2024 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@MelGrubb
Copy link

MelGrubb commented May 6, 2024

I have checked the following:

  • I've searched existing issues and found nothing related to my issue.

Describe the feature you want to add

The iteration count on the collection runner could be used for performance testing if it had an option to disable running the tests in parallel. For instance, I'd like to run a certain request 10 times so that I can figure out the average timing. Running the tests in parallel shows how it will perform under high load, but running them serially would be more useful for evaluating whether a specific change makes things better or worse.

Also, on the Runner page, it would be very helpful if the results table included timing information broken down per request. You can dig this information out by drilling into each iteration and finding the request you're interested in.

And finally, some way to run multiple iterations of a single request would be very helpful, especially when I'm trying to tune an individual operation. For now, I can just move the request to a folder and run that “collection”, but a more official way would be better.

My use case is testing whether a query optimization is actually making things better or worse. I want to run an individual query 10 times, and gather the average time for the whole run before and after each tweak I make.

Mockups or Images of the feature

image
image

@MelGrubb MelGrubb added the enhancement New feature or request label May 6, 2024
@helloanoop helloanoop assigned helloanoop and lohxt1 and unassigned helloanoop May 6, 2024
@helloanoop
Copy link
Contributor

@lohxt1 Assigning this to you.

Please work on it when you find some time. I believe this should be a relatively straightforward implementation.
Showing the time info would also be really helpful.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants