Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Undesired partition migration happening because of stale metadata #4687

Closed
1 of 7 tasks
emasab opened this issue Apr 15, 2024 · 0 comments
Closed
1 of 7 tasks

Undesired partition migration happening because of stale metadata #4687

emasab opened this issue Apr 15, 2024 · 0 comments

Comments

@emasab
Copy link
Collaborator

emasab commented Apr 15, 2024

Description

A partition migration can happen, using stale metadata, when the partition is validating a next_fetch_start and retring the validation.
It can use stale metadata with an invalid leader epoch and migrate back to the previous leader. Later this is corrected but it's sub-optimal.

How to reproduce

Execute test 0146/do_test_stale_metadata_doesnt_migrate_partition in #4680.

Checklist

Please provide the following information:

  • librdkafka version (2.1.0)
  • Apache Kafka version: <REPLACE with e.g., 0.10.2.3>
  • librdkafka client configuration: <REPLACE with e.g., message.timeout.ms=123, auto.reset.offset=earliest, ..>
  • Operating system: <REPLACE with e.g., Centos 5 (x64)>
  • Provide logs (with debug=.. as necessary) from librdkafka
  • Provide broker log excerpts
  • Critical issue
@emasab emasab closed this as completed May 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant