Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Remote Compaction] Additional debug logging for InputFileCheck Failure #13452

Closed

Conversation

jaykorean
Copy link
Contributor

@jaykorean jaykorean commented Mar 10, 2025

Summary

Add debug logging when the Wait() does not return kSuccess so that we can compare the version state that was printed by the logging added in #13427 upon InputFileCheck failure.

Test Plan

CI + Tested with Temporary Change in Meta Internal Infra

@jaykorean jaykorean force-pushed the remote_compaction_more_debug_log branch from a65ab98 to bfe7ce8 Compare March 10, 2025 16:03
@jaykorean jaykorean requested review from anand1976 and hx235 March 10, 2025 16:20
@jaykorean jaykorean marked this pull request as ready for review March 10, 2025 16:20
@jaykorean jaykorean force-pushed the remote_compaction_more_debug_log branch from bfe7ce8 to da8c54a Compare March 10, 2025 16:21
jaykorean added a commit to jaykorean/rocksdb that referenced this pull request Mar 10, 2025
Summary:
Add debug logging when the Wait() does not return `kSuccess` so that we can compare the version state that was printed by the logging added in facebook#13427 upon InputFileCheck failure.

# Test Plan 

CI + Tested with Temporary Change in Meta Internal Infra


Differential Revision: D70898832

Pulled By: jaykorean
@facebook-github-bot
Copy link
Contributor

@jaykorean has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

Copy link
Contributor

@hx235 hx235 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left a question about hex

@@ -110,6 +110,9 @@ CompactionJob::ProcessKeyValueCompactionWithCompactionService(
break;
}

std::string debug_str_before_wait =
compaction->input_version()->DebugString();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we not need the hex=true here for printing the smallest key in the file etc

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We are only interested in the SST files in each input level. Basically the issue is that remote worker is not able to locate the input SST files in the vstorage. Key-level information is not needed for this purpose.

I am planning to remove this extra debug logging when we complete fixing the issue. (I can probably add TODO comment to remind myself :))

@facebook-github-bot
Copy link
Contributor

@jaykorean merged this pull request in 22ca6e5.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants