[pull] master from apache:master - #182
Merged
Merged
Conversation
Co-authored-by: damccorm <actions@GitHub Actions 1010719742.local>
* Migrate Cloudbuild usage to Python client * linting * slide cloud build into main deoendency * Base image requirement updates * attempt to make google.api_core a non-default dependency * yapf
* Update website for 2.71.0 release * Update website/www/site/content/en/blog/beam-2.71.0.md Co-authored-by: tvalentyn <tvalentyn@users.noreply.github.com> * Update CHANGES.md * Update release date for version 2.71.0 * Update download link for Beam 2.71.0 release --------- Co-authored-by: tvalentyn <tvalentyn@users.noreply.github.com>
* [#37209] Enhance serialization error messages for better DX Improved error messages when user code fails to serialize (pickle) for distributed execution. The original error was too technical and didn't explain the cause or suggest fixes. Changes: - Enhanced RuntimeError message with clear explanation of why serialization is required - Added common causes (lambdas capturing file handles, DB connections, thread locks) - Provided three concrete fixes: module-level functions, setup() methods, checking closure captures - Broadened exception catching to include TypeError and other pickling failures (not just RuntimeError) - Added exception chaining (from e) to preserve original stack trace - Added test case to verify the new error message content This significantly improves developer experience when debugging serialization issues, especially for new Apache Beam users. Fixes #37209 Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com> * Apply yapf formatting Fix Python formatter precommit check by applying yapf v0.43.0 formatting rules to modified files. * [#37209] Make withBackOffSupplier public to enable bounded retry configuration Users need to configure bounded backoff to prevent infinite retry loops. Making withBackOffSupplier public allows users to set FluentBackoff.DEFAULT.withMaxRetries(n) and control retry behavior. Added integration test demonstrating bounded retry with maxRetries=3. Related to #37198, #37176 Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com> * Revert unrelated Java changes --------- Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
See Commits and Changes for more details.
Created by
pull[bot] (v2.0.0-alpha.4)
Can you help keep this open source service alive? 💖 Please sponsor : )