Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

broadcastDBInfoRequest should minimize cross DC/Locality calls #9777

Open
jzhou77 opened this issue Mar 22, 2023 · 0 comments
Open

broadcastDBInfoRequest should minimize cross DC/Locality calls #9777

jzhou77 opened this issue Mar 22, 2023 · 0 comments
Assignees

Comments

@jzhou77
Copy link
Contributor

jzhou77 commented Mar 22, 2023

broadcastDBInfoRequest() today takes a list of workers, ordered by processID, divides them into batches, and sends a batch to one worker. The worker receives the batch recursively calls broadcastDBInfoRequest() to distribute the request.

This broadcast doesn't take the network topology into consideration. As a result, cluster controller may send a request to a remote DC, which then forwards the request back to the primary DC. A better way is to minimize cross DC or Locality traffic by dividing batches such that the workers in the same batch belong to a DC/Locality.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants