Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Backport 5.4] : compaction: improve partition estimates when using garbage collected sstables #18656

Closed

Conversation

lkshminarayanan
Copy link
Member

When a compaction strategy uses garbage collected sstables to track expired tombstones, do not use complete partition estimates for them, instead, use a fraction of it based on the droppable tombstone ratio estimate.

Fixes #18283

Signed-off-by: Lakshmi Narayanan Sreethar lakshmi.sreethar@scylladb.com

Closes #18465

(cherry picked from commit d39adf6)

When a compaction strategy uses garbage collected sstables to track
expired tombstones, do not use complete partition estimates for them,
instead, use a fraction of it based on the droppable tombstone ratio
estimate.

Fixes scylladb#18283

Signed-off-by: Lakshmi Narayanan Sreethar <lakshmi.sreethar@scylladb.com>

Closes scylladb#18465

(cherry picked from commit d39adf6)
@lkshminarayanan lkshminarayanan requested a review from nyh as a code owner May 13, 2024 18:21
@lkshminarayanan lkshminarayanan self-assigned this May 13, 2024
@lkshminarayanan lkshminarayanan requested review from raphaelsc and removed request for nyh May 13, 2024 18:22
denesb pushed a commit that referenced this pull request May 14, 2024
When a compaction strategy uses garbage collected sstables to track
expired tombstones, do not use complete partition estimates for them,
instead, use a fraction of it based on the droppable tombstone ratio
estimate.

Fixes #18283

Signed-off-by: Lakshmi Narayanan Sreethar <lakshmi.sreethar@scylladb.com>

Closes #18465

(cherry picked from commit d39adf6)

Closes #18656
@scylladb-promoter
Copy link
Contributor

🟢 CI State: SUCCESS

✅ - Build
✅ - dtest
✅ - Unit Tests

Build Details:

  • Duration: 5 hr 43 min
  • Builder: i-01145b5844cafcaf2 (m5ad.12xlarge)

@mykaul
Copy link
Contributor

mykaul commented May 19, 2024

@scylladb/scylla-maint - please review and merge if ready (note: 5.2 backport - #18659 - is already queued)

@yaronkaikov
Copy link
Contributor

@mykaul Already in branch-5.4 via 4b0c60c

@lkshminarayanan lkshminarayanan deleted the compaction-gc-5.4 branch May 21, 2024 04:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants