Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove unused deps #1521

Merged
merged 4 commits into from
May 21, 2024
Merged

Remove unused deps #1521

merged 4 commits into from
May 21, 2024

Conversation

Copy link

github-actions bot commented May 16, 2024

Test Results

 99 files  ±0   99 suites  ±0   8m 28s ⏱️ +3s
 84 tests ±0   82 ✅ ±0  2 💤 ±0  0 ❌ ±0 
216 runs  ±0  210 ✅ ±0  6 💤 ±0  0 ❌ ±0 

Results for commit ff2ff70. ± Comparison against base commit c4abe86.

♻️ This comment has been updated with latest results.

Copy link
Contributor

@tillrohrmann tillrohrmann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the cleanup work @AhmedSoliman. Did you use some tooling to find the unused dependencies (udeps or so)? LGTM. +1 for merging.

@@ -80,7 +80,6 @@ async-channel = "2.1.1"
async-trait = "0.1.73"
axum = "0.6.18"
base64 = "0.21"
bincode = { version = "2.0.0-rc", default-features = false, features = ["std", "serde", ] }
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤩

@AhmedSoliman
Copy link
Contributor Author

Yes, I used cargo udeps.

@AhmedSoliman AhmedSoliman force-pushed the pr1521 branch 2 times, most recently from 72e08eb to cb87d88 Compare May 21, 2024 09:33
This PR includes:
- Attachment of PPM to cluster controller now use Networking
- PPM observes partition processor status through a buffered watch mechanism
- PPM can now send control messages (unused at this PR) to processor for future use.
- PPM collects state information from running processors. This will be used in a follow PR to response to controller requests about partitions.


Cluster controller grpc service is kept for external tooling integration (CLI, etc.)
ClusterState is a new data structure maintained by ClusterController. ClusterState is established by a scatter-gather request (GetProcessorsState) to all workers. For every worker, partition processor manager is the entity responsible for responding to GetProcessorsState requests, it keeps taps on running partition processors via a set of tokio watches.

This PR is a snapshot in time of progress done on this component, this is far from complete but it's best to merge the current progress until we circle back to it in a week or two.
This also changes the loglet API to accept Bytes to avoid duplication of serialization across loglet implementations. This holds the current invariant that payloads are opaque to loglets.
@AhmedSoliman AhmedSoliman merged commit 32e3f71 into main May 21, 2024
10 checks passed
@AhmedSoliman AhmedSoliman deleted the pr1521 branch May 21, 2024 10:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants