Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions:How to improve write speed to cassandra #679

Open
waittingsummer opened this issue May 11, 2023 · 2 comments
Open

Questions:How to improve write speed to cassandra #679

waittingsummer opened this issue May 11, 2023 · 2 comments

Comments

@waittingsummer
Copy link

I have massive data writing requirements, but also a certain need to read
Now kairsodb + cassandra
image

RF=3 RL=QUORUM WL=QUORUM
The problem is that data often piles up in the queue directory
image

@waittingsummer waittingsummer changed the title How to improve write speed to cassandra Questions:How to improve write speed to cassandra May 11, 2023
@brianhks
Copy link
Member

So if the queue is growing that means sending data to cassandra is not keeping up. One thing to check is if your cache is working correctly. Check this metric and group by table: kairosdb.datastore.cassandra.write_batch_size.sum
This depends greatly on your data you are sending in. If the metric names and tags are a fixed or limited set then the cache if big enough should prevent writing to any other table but data_points. The metric will reveal what is going on.

@MujeerAhmed
Copy link

@waittingsummer you can increase the IOPS of your mounted volumes. I remember facing this same issue as well, and consider migrating to ScyllaDB. Kairos works just as good with Scylla as it does with Cassandra.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants