You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit df077b6
Browse filesBrowse the repository at this point in the historyBrowse files
[python] Move commit dedup parameters from table options to a runtime argument
The three commit.dedup-* options were read from CoreOptions, which flow
through table.copy() and are inherited by every writer built from that
table. The dedup bound describes one writer at one instant, so putting
it in table properties causes cross-task contamination in the actor mode:
a base_snapshot pinned for task 0 would be inherited by tasks 1..N as
though they had also had their bounds validated.
Replace them with a CommitDedup value object passed as a keyword-only
argument to new_commit(dedup=...). The object is consumed by
FileStoreCommit and never written to any property store. The three
CoreOptions entries and their accessors are removed.
Also log a WARNING when first-attempt dedup is requested on a table
with commit.native.enabled=true: the native committer returns before the
Python duplicate-commit scan is reached, so a replayed commit on that
path can publish the same files twice. The scan is not implemented in
the native path; the warning makes the hazard visible without blocking
the write.
Co-Authored-By: Claude Code <noreply@anthropic.com>
0 commit comments