Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

python infra to measure total-space-efficiency & point-in-time space efficiency #7770

Open
Tracked by #7554
problame opened this issue May 15, 2024 · 1 comment
Open
Tracked by #7554
Assignees
Labels
a/test Area: related to testing c/storage/pageserver Component: storage: pageserver

Comments

@problame
Copy link
Contributor

problame commented May 15, 2024

Meeting notes / ideas:

  • point-in-time efficiency: Use layer map dump / keyspace dump (not actually measure it by access)
  • total space efficiency:
    • (logical size + wal in PITR window) = synthetic size, can just use that
    • sum(all layer files in index_part.json) => just that

Demo test case to adapt / apply the Python helpers to:

  • test_gc_feedback
@problame problame changed the title test_gc_feedback: duplicate & adapt to measure / regress-test point-in-time space efficiency python infra to measure total-space-efficiency & point-in-time space efficiency May 15, 2024
@jcsp jcsp added c/storage/pageserver Component: storage: pageserver a/test Area: related to testing labels May 20, 2024
@problame
Copy link
Contributor Author

This week:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
a/test Area: related to testing c/storage/pageserver Component: storage: pageserver
Projects
None yet
Development

No branches or pull requests

3 participants