Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Spark] Extend streaming tests with coordinated commits (1/2) #4039

Merged

Conversation

ctring
Copy link
Contributor

@ctring ctring commented Jan 10, 2025

Which Delta project/connector is this regarding?

  • Spark
  • Standalone
  • Flink
  • Kernel
  • Other (fill in here)

Description

  • Unify the modifyCommitTimestamp helper functions to avoid code duplication.
  • Extend existing streaming tests to run with coordinated commits

How was this patch tested?

Run the new tests

Does this PR introduce any user-facing changes?

No

@ctring ctring force-pushed the cuong-nguyen_data/streaming-tests-0 branch from 83c4c56 to a8e4088 Compare January 15, 2025 18:55
@ctring ctring force-pushed the cuong-nguyen_data/streaming-tests-0 branch 3 times, most recently from 2f9460c to 41786f4 Compare February 2, 2025 02:51
@ctring ctring force-pushed the cuong-nguyen_data/streaming-tests-0 branch from 41786f4 to 3bd7e1b Compare February 10, 2025 20:01
Copy link
Contributor

@junlee-db junlee-db left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ctring ctring force-pushed the cuong-nguyen_data/streaming-tests-0 branch from 3bd7e1b to 106fc26 Compare February 11, 2025 01:37
@vkorukanti vkorukanti merged commit 34f9f0b into delta-io:master Feb 11, 2025
16 of 19 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants