[SPARK-56768][PYTHON][INFRA] Share SBT compile artifact across pyspar… #18287
HyukjinKwonbuild_main.yml
on: push
Run
/
Check changes
1m 26s
Run
/
Protobuf breaking change detection and Python CodeGen check
Run
/
Java 17 build with Maven
Run
/
Java 25 build with Maven
Run
/
Run TPC-DS queries with SF=1
Run
/
Run Docker integration tests
Run
/
Run Spark on Kubernetes Integration test
Run
/
Run Spark UI tests
Matrix: Run / build
Run
/
Build modules: sparkr
0s
Run
/
Linters, licenses, and dependencies
13m 2s
Run
/
Documentation generation
0s
Matrix: Run / pyspark
Annotations
19 errors and 40 warnings
|
Run / Precompile Spark
Process completed with exit code 1.
|
|
Run / Build modules: hive - other tests
Process completed with exit code 16.
|
|
Run / Build modules: mllib-local, mllib, graphx, profiler, pipelines
Process completed with exit code 16.
|
|
Run / Linters, licenses, and dependencies
Process completed with exit code 1.
|
|
Run / Build modules: sql - other tests
Process completed with exit code 16.
|
|
Run / Build modules: core, unsafe, kvstore, avro, utils, utils-java, network-common, network-shuffle, repl, launcher, examples, sketch, variant
Process completed with exit code 16.
|
|
Run / Build modules: api, catalyst, hive-thriftserver
Process completed with exit code 16.
|
|
Run / Build modules: hive - slow tests
Process completed with exit code 16.
|
|
|
|
Run / Build modules: sql - extended tests
Process completed with exit code 16.
|
|
Run / Build modules: sql - slow tests
Process completed with exit code 16.
|
|
Run / Build modules: pyspark-streaming, pyspark-structured-streaming, pyspark-structured-streaming-connect
Process completed with exit code 16.
|
|
Run / Build modules: pyspark-streaming, pyspark-structured-streaming, pyspark-structured-streaming-connect
Unable to download artifact(s): Artifact not found for name: spark-compile-master-25549193181
Please ensure that your artifact is not expired and the artifact was uploaded using a compatible version of toolkit/upload-artifact.
For more information, visit the GitHub Artifacts FAQ: https://github.com/actions/toolkit/blob/main/packages/artifact/docs/faq.md
|
|
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing, pyspark-core, pyspark-errors, pyspark-logger
Process completed with exit code 16.
|
|
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing, pyspark-core, pyspark-errors, pyspark-logger
Unable to download artifact(s): Artifact not found for name: spark-compile-master-25549193181
Please ensure that your artifact is not expired and the artifact was uploaded using a compatible version of toolkit/upload-artifact.
For more information, visit the GitHub Artifacts FAQ: https://github.com/actions/toolkit/blob/main/packages/artifact/docs/faq.md
|
|
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect, pyspark-pipelines
Process completed with exit code 16.
|
|
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect, pyspark-pipelines
Unable to download artifact(s): Artifact not found for name: spark-compile-master-25549193181
Please ensure that your artifact is not expired and the artifact was uploaded using a compatible version of toolkit/upload-artifact.
For more information, visit the GitHub Artifacts FAQ: https://github.com/actions/toolkit/blob/main/packages/artifact/docs/faq.md
|
|
Run / Build modules: pyspark-connect
Process completed with exit code 16.
|
|
Run / Build modules: pyspark-connect
Unable to download artifact(s): Artifact not found for name: spark-compile-master-25549193181
Please ensure that your artifact is not expired and the artifact was uploaded using a compatible version of toolkit/upload-artifact.
For more information, visit the GitHub Artifacts FAQ: https://github.com/actions/toolkit/blob/main/packages/artifact/docs/faq.md
|
|
Run / Base image build
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: docker/build-push-action@10e90e3645eae34f1e60eeb005ba3a3d33f178e8, docker/login-action@c94ce9fb468520275223c153574b00df6fe4bcc9, docker/setup-buildx-action@8d2750c68a42422c14e847fe6c8ac0403b4cbd6f, docker/setup-qemu-action@29109295f81e9208d7d86ff1c6c12d2833863392. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: hive - other tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: hive - other tests
No files were found with the provided path: **/target/*.log. No artifacts will be uploaded.
|
|
Run / Build modules: hive - other tests
No files were found with the provided path: **/target/test-reports/*.xml
**/target/surefire-reports/*.xml. No artifacts will be uploaded.
|
|
Run / Build modules: mllib-local, mllib, graphx, profiler, pipelines
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: mllib-local, mllib, graphx, profiler, pipelines
No files were found with the provided path: **/target/*.log. No artifacts will be uploaded.
|
|
Run / Build modules: mllib-local, mllib, graphx, profiler, pipelines
No files were found with the provided path: **/target/test-reports/*.xml
**/target/surefire-reports/*.xml. No artifacts will be uploaded.
|
|
Run / Build modules: sql - other tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: sql - other tests
No files were found with the provided path: **/target/*.log. No artifacts will be uploaded.
|
|
Run / Build modules: sql - other tests
No files were found with the provided path: **/target/test-reports/*.xml
**/target/surefire-reports/*.xml. No artifacts will be uploaded.
|
|
Run / Build modules: core, unsafe, kvstore, avro, utils, utils-java, network-common, network-shuffle, repl, launcher, examples, sketch, variant
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: core, unsafe, kvstore, avro, utils, utils-java, network-common, network-shuffle, repl, launcher, examples, sketch, variant
No files were found with the provided path: **/target/*.log. No artifacts will be uploaded.
|
|
Run / Build modules: core, unsafe, kvstore, avro, utils, utils-java, network-common, network-shuffle, repl, launcher, examples, sketch, variant
No files were found with the provided path: **/target/test-reports/*.xml
**/target/surefire-reports/*.xml. No artifacts will be uploaded.
|
|
Run / Build modules: api, catalyst, hive-thriftserver
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: api, catalyst, hive-thriftserver
No files were found with the provided path: **/target/*.log. No artifacts will be uploaded.
|
|
Run / Build modules: api, catalyst, hive-thriftserver
No files were found with the provided path: **/target/test-reports/*.xml
**/target/surefire-reports/*.xml. No artifacts will be uploaded.
|
|
Run / Build modules: hive - slow tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: hive - slow tests
No files were found with the provided path: **/target/*.log. No artifacts will be uploaded.
|
|
Run / Build modules: hive - slow tests
No files were found with the provided path: **/target/test-reports/*.xml
**/target/surefire-reports/*.xml. No artifacts will be uploaded.
|
|
Run / Build modules: streaming, sql-kafka-0-10, streaming-kafka-0-10, streaming-kinesis-asl, kubernetes, hadoop-cloud, spark-ganglia-lgpl, protobuf, connect
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: streaming, sql-kafka-0-10, streaming-kafka-0-10, streaming-kinesis-asl, kubernetes, hadoop-cloud, spark-ganglia-lgpl, protobuf, connect
No files were found with the provided path: **/target/*.log. No artifacts will be uploaded.
|
|
Run / Build modules: streaming, sql-kafka-0-10, streaming-kafka-0-10, streaming-kinesis-asl, kubernetes, hadoop-cloud, spark-ganglia-lgpl, protobuf, connect
No files were found with the provided path: **/target/test-reports/*.xml
**/target/surefire-reports/*.xml. No artifacts will be uploaded.
|
|
Run / Build modules: sql - extended tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: sql - extended tests
No files were found with the provided path: **/target/*.log. No artifacts will be uploaded.
|
|
Run / Build modules: sql - extended tests
No files were found with the provided path: **/target/test-reports/*.xml
**/target/surefire-reports/*.xml. No artifacts will be uploaded.
|
|
Run / Build modules: sql - slow tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: sql - slow tests
No files were found with the provided path: **/target/*.log. No artifacts will be uploaded.
|
|
Run / Build modules: sql - slow tests
No files were found with the provided path: **/target/test-reports/*.xml
**/target/surefire-reports/*.xml. No artifacts will be uploaded.
|
|
Run / Build modules: pyspark-streaming, pyspark-structured-streaming, pyspark-structured-streaming-connect
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/download-artifact@v6, test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: pyspark-streaming, pyspark-structured-streaming, pyspark-structured-streaming-connect
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
|
|
Run / Build modules: pyspark-streaming, pyspark-structured-streaming, pyspark-structured-streaming-connect
No files were found with the provided path: **/target/test-reports/*.xml
**/target/surefire-reports/*.xml. No artifacts will be uploaded.
|
|
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing, pyspark-core, pyspark-errors, pyspark-logger
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/download-artifact@v6, test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing, pyspark-core, pyspark-errors, pyspark-logger
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
|
|
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing, pyspark-core, pyspark-errors, pyspark-logger
No files were found with the provided path: **/target/test-reports/*.xml
**/target/surefire-reports/*.xml. No artifacts will be uploaded.
|
|
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect, pyspark-pipelines
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/download-artifact@v6, test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect, pyspark-pipelines
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
|
|
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect, pyspark-pipelines
No files were found with the provided path: **/target/test-reports/*.xml
**/target/surefire-reports/*.xml. No artifacts will be uploaded.
|
|
Run / Build modules: pyspark-connect
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/download-artifact@v6, test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: pyspark-connect
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
|
|
Run / Build modules: pyspark-connect
No files were found with the provided path: **/target/test-reports/*.xml
**/target/surefire-reports/*.xml. No artifacts will be uploaded.
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
apache~spark~88Q8ZX.dockerbuild
|
35.9 KB |
sha256:153590f1f4bb70d29d30eadf5f0a526288b0b942471d7a7b0ed1fbbb8100cb29
|
|
|
apache~spark~N2PSVJ.dockerbuild
|
30.3 KB |
sha256:9b5850a7e2923ef7b9ec8e9d79b98bf49ededea3c05f8c0b13b58427acbe4dff
|
|