-
Notifications
You must be signed in to change notification settings - Fork 28.9k
Pull requests: apache/spark
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[SPARK-53696][PYTHON]Default to bytes for BinaryType in PySpark UDF
CONNECT
CORE
PYTHON
SQL
#52467
opened Sep 26, 2025 by
xianzhe-databricks
•
Draft
[SPARK-53728][SDP] Print PipelineEvent Message with Error In Test
CONNECT
SQL
#52463
opened Sep 26, 2025 by
JiaqiWang18
Loading…
[SPARK-53720][SQL] Simplify extracting Table from DataSourceV2Relation
SQL
STRUCTURED STREAMING
#52460
opened Sep 25, 2025 by
aokolnychyi
Loading…
[SPARK-53707] Improve attribute metadata handling.
SQL
#52449
opened Sep 25, 2025 by
ksbeyer
Loading…
Test buf plugin v29.5
CONNECT
PYTHON
SQL
STRUCTURED STREAMING
#52448
opened Sep 25, 2025 by
LuciferYang
•
Draft
[SPARK-53690][SS] Fix exponential formatting of avgOffsetsBehindLatest in Kafka sources object in progress json
SQL
STRUCTURED STREAMING
#52445
opened Sep 25, 2025 by
jayantdb
Loading…
[SPARK-46679][SQL] Fix for SparkUnsupportedOperationException Not found an encoder of the type T, when using Parameterized class
SQL
#52444
opened Sep 25, 2025 by
szehon-ho
Loading…
[SPARK-53406][SQL] Avoid unnecessary shuffle join in direct passthrough shuffle id
SQL
#52443
opened Sep 25, 2025 by
shujingyang-db
Loading…
[SPARK-49547][SQL][PYTHON] Add iterator of
RecordBatch
API to applyInArrow
CONNECT
CORE
PYTHON
SQL
#52440
opened Sep 24, 2025 by
Kimahriman
Loading…
[SPARK-53691][PS][INFRA][TESTS] Further reorganize tests for Pandas API
BUILD
INFRA
#52433
opened Sep 24, 2025 by
zhengruifeng
Loading…
[SPARK-53687][SQL][SS][SDP] Introduce WATERMARK clause in SQL statement
DOCS
SQL
STRUCTURED STREAMING
#52428
opened Sep 24, 2025 by
HeartSaVioR
Loading…
[SPARK-53686][SQL] DESC column should print out default value
SQL
#52427
opened Sep 24, 2025 by
shujingyang-db
Loading…
[SPARK-53676][PYTHON] Extend to support column name
CONNECT
PYTHON
SQL
#52420
opened Sep 23, 2025 by
malthe
Loading…
[SPARK-53666][DOCS] Add script to generate llms.txt file for Spark main website
BUILD
INFRA
#52412
opened Sep 22, 2025 by
allisonwang-db
•
Draft
[DO-NOT-MERGE][DRAFT] Test workflow for python 3.11 and spark connect 3.5
CONNECT
INFRA
PYTHON
STRUCTURED STREAMING
#52408
opened Sep 22, 2025 by
shujingyang-db
•
Draft
[SPARK-53659][SQL] Infer Variant shredding schema when writing to Parquet
SQL
#52406
opened Sep 22, 2025 by
cashmand
Loading…
[SPARK-53658][CONNECT] Accept literal data_type field in ExecutePlanResponse
CONNECT
PYTHON
SQL
#52405
opened Sep 22, 2025 by
heyihong
Loading…
[SPARK-53656][SS] Refactor MemoryStream to use SparkSession instead of SQLContext
SQL
STRUCTURED STREAMING
#52402
opened Sep 22, 2025 by
ganeshashree
Loading…
[SPARK-53665][DOCS] Fix minor grammar/typos in sql-programming-guide.md
DOCS
#52396
opened Sep 19, 2025 by
Username46786
Loading…
[SPARK-53638][SS][PYTHON] Limit the byte size of arrow batch for TWS to avoid OOM
CORE
PYTHON
SQL
STRUCTURED STREAMING
#52391
opened Sep 18, 2025 by
zeruibao
Loading…
[SPARK-39328][SQL][TESTS] Fix flaky test
SPARK-37753: Inhibit broadcast in left outer join when there are many empty partitions on outer/left side
SQL
#52388
opened Sep 18, 2025 by
Last-remote11
Loading…
[SPARK-53636][CORE] Fix thread-safety issue in SortShuffleManager.unregisterShuffle
CORE
#52386
opened Sep 18, 2025 by
Ngone51
Loading…
Previous Next
ProTip!
Updated in the last three days: updated:>2025-09-23.