Skip to content

Prevent recipe wrangle from writing partial batches - #1096

Merged
mborodii-prog merged 1 commit into
devfrom
fix-map-issue
Jul 28, 2026
Merged

mborodii-prog merged 1 commit into
devfrom
fix-map-issue

Conversation

@mborodii-prog

@mborodii-prog mborodii-prog commented Jul 28, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Prevent nested recipe writes from running when
    ecipe is used as a wrangle.
  • Fix batch scenarios where an attached recipe with its own write step overwrote spreadsheet output once per batch, leaving only the final partial batch.
  • Add regression coverage for 1000 input rows with �atch_size: 100, ensuring only the outer final write persists all 1000 rows.

Tests

  • Targeted recipe connector tests passed: 12 passed, 2 deselected.
  • Targeted batch tests passed: 6 passed.
  • python -m py_compile wrangles/recipe_wrangles/main.py tests/connectors/test_recipe.py passed.

@mborodii-prog
mborodii-prog merged commit 251a4bf into dev Jul 28, 2026
3 checks passed
@mborodii-prog
mborodii-prog deleted the fix-map-issue branch July 28, 2026 13:58
pull Bot pushed a commit to admariner/WranglesPY that referenced this pull request Aug 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant