Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scan server file references stored in the metadata table can cause hotspots and empty metadata tablets #4493

Open
keith-turner opened this issue Apr 25, 2024 · 0 comments · May be fixed by #4596
Labels
enhancement This issue describes a new feature, improvement, or optimization.

Comments

@keith-turner
Copy link
Contributor

Is your feature request related to a problem? Please describe.

Scan server references stored in the metadata table use a fully qualified file path in the row. This can lead to the same problems as described in #1043 that gc candidates stored in the metadata table used to have. The code that write scan server refs can be found here

Describe the solution you'd like

The solution to #1043 was to store a hash of the file path in front of the file path in the metadata table. Something similar could be done for these refs, or the uuid for the scan server that is currently stored in the qualifier could be moved in front of the file.

@keith-turner keith-turner added the enhancement This issue describes a new feature, improvement, or optimization. label Apr 25, 2024
@keith-turner keith-turner added this to To do in 2.1.3 via automation Apr 25, 2024
@keith-turner keith-turner added this to To do in 3.1.0 via automation Apr 25, 2024
@ddanielr ddanielr linked a pull request May 8, 2024 that will close this issue
@ddanielr ddanielr linked a pull request May 23, 2024 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement This issue describes a new feature, improvement, or optimization.
Projects
2.1.3
To do
3.1.0
To do
Status: No status
1 participant