New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[compaction]refact compaction work operator for supporting multi unaware bucket tables. #3175
base: master
Are you sure you want to change the base?
Conversation
* The help class for the Compaction of unware bucket append table to execute {@link | ||
* AppendOnlyCompactionTask}. | ||
*/ | ||
public class UnwareBucketCompactionHelper { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
UnwareBucketCompactor
? This class actually does the compaction job, so it is the real compactor.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
this.compactExecutorsupplier = lazyCompactExecutor; | ||
} | ||
|
||
public void processElement(StreamRecord<AppendOnlyCompactionTask> element) throws Exception { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
public void submit(AppendOnlyCompactionTask task) throws Exception
? Compactor does not need to access StreamRecord
, just pass AppendOnlyCompactionTask
to it is okay.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
046e5fe
to
28e7f20
Compare
5abf5e3
to
4b86018
Compare
related #2670
Purpose
Linked issue: close #xxx
Tests
AppendOnlyMultiTableCompactionWorkerOperatorTest.java for test AppendOnlyMultiTableCompactionWorkerOperator
API and Format
Documentation