Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature: Allow sending DMLs to different Kafka topics based on table name #42

Open
bersler opened this issue Feb 6, 2023 · 3 comments
Labels
enhancement New feature or request

Comments

@bersler
Copy link
Owner

bersler commented Feb 6, 2023

Is your feature request related to a problem? Please describe.
Currently all transactions are sent just to one Kafka topic.

Describe the solution you'd like
It would be useful to divide the load into multiple topics and send transactions to certain topic based on table name or other conditions.

Describe alternatives you've considered
To divide the load - such spread of transactions to multiple Kafka topics can be made as an another level of transaction processing.

Additional context
Dividing transactions might mean that we lose transaction consistency.

@bersler bersler added the enhancement New feature or request label Feb 6, 2023
@bersler
Copy link
Owner Author

bersler commented Feb 6, 2023

This feature is complicated to implement.. If there is a demand from users more focus could be given here.

@sonnguyen-dba
Copy link

Hi Adam,
I think this feature very useful for resource. (reduce the number of instance OpenLogReplicator ).

Regards,
Son

@bersler
Copy link
Owner Author

bersler commented Apr 2, 2023

Thanks @sonnguyen-dba , I agree. This might help user a lot.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants