-
Notifications
You must be signed in to change notification settings - Fork 28.7k
[SPARK-51415][SQL] Support the time type by make_timestamp() #51543
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
One CI failure, looks unrelated. Re-running the test to see if it clears.
Otherwise, ready for review @MaxGekk.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@uros-db Could you test the cases #51179 (review)
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala
Outdated
Show resolved
Hide resolved
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala
Outdated
Show resolved
Hide resolved
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala
Outdated
Show resolved
Hide resolved
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala
Outdated
Show resolved
Hide resolved
cc @yaooqinn @LuciferYang @cloud-fan since you reviewed my PR: #51179 |
What changes were proposed in this pull request?
Modify the
make_timestamp
function to create a timestamp from date and time (and optional timezone).Arguments
date
: A date expressiontime
: A time expressionReturns
Examples
Why are the changes needed?
Users will be able to create a timestamp with (or without time zone) by using a date and time inputs.
Does this PR introduce any user-facing change?
Yes, it adds new SQL function syntax support.
How was this patch tested?
New unit tests for timestamp calculation, catalyst expression level unit tests with & without codegen, Scala function unit tests, e2e SQL tests / golden files in both ANSI and non-ANSI modes.
Was this patch authored or co-authored using generative AI tooling?
No.