Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Reuse vector in LocalPartition #12002

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

Yuhta
Copy link
Contributor

@Yuhta Yuhta commented Jan 2, 2025

Summary:
More than 10% of the CPU are spent on the destruction of local partition output when the load is high.

Also add some optimizations for serialization.

Differential Revision: D67742489

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 2, 2025
Copy link

netlify bot commented Jan 2, 2025

Deploy Preview for meta-velox canceled.

Name Link
🔨 Latest commit d4fbc7e
🔍 Latest deploy log https://app.netlify.com/sites/meta-velox/deploys/677720ca4a581600081b93f0

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D67742489

Summary:
X-link: facebookincubator/nimble#122

More than 10% of the CPU are spent on the destruction of local partition output when the load is high.

Also add some optimizations for serialization.  Optimization on `ByteOutputStream::appendOneBool` does not show significant gain in the query in example (because they are a lot small batches), but it is net gain and would be significant in large batches, so I leave it in the code.

Differential Revision: D67742489
@Yuhta Yuhta force-pushed the export-D67742489 branch from 232444d to d4fbc7e Compare January 2, 2025 23:27
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D67742489

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants