Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KAFKA-16810: Add flag to read from specific partitions while checking consumer performance #15905

Open
wants to merge 1 commit into
base: trunk
Choose a base branch
from

Conversation

BOOTMGR
Copy link

@BOOTMGR BOOTMGR commented May 9, 2024

kafka-consumer-perf-test is a great tool to quickly check raw consumer performance. Currently, It subscribes to all the partitions and gives overall cluster performance, however If we want to test performance of single broker/partition, existing tool does not support.

This PR introduces two optional flags --partitions and --offsets which gives flexibility to benchmark only specific partitions optionally from specified offsets.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify documentation (including upgrade notes)
  • Verify test coverage and CI build status

@lianetm
Copy link
Contributor

lianetm commented May 14, 2024

Hey @BOOTMGR, I would expect we need a KIP for this. It brings changes in the command line tool arguments, which is considered a public interface (check KIP page here)

@BOOTMGR
Copy link
Author

BOOTMGR commented May 15, 2024

Hey @BOOTMGR, I would expect we need a KIP for this. It brings changes in the command line tool arguments, which is considered a public interface (check KIP page here)

Thanks for looking into this, I will file KIP.

@BOOTMGR BOOTMGR changed the title MINOR: Add flag to read from specific partitions while checking consumer performance KAFKA-16810: Add flag to read from specific partitions while checking consumer performance May 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants