Update spark 3.4 from 3.4.2 to 3.4.3 #17364
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Also cc @dongjoon-hyun |
Diff for 1df6f09:diff --git a/_bashbrew-cat b/_bashbrew-cat
index 4256d63..75fa442 100644
--- a/_bashbrew-cat
+++ b/_bashbrew-cat
@@ -1,25 +1,25 @@
Maintainers: Apache Spark Developers <[email protected]> (@ApacheSpark)
GitRepo: https://github.com/apache/spark-docker.git
-Tags: 3.4.2-scala2.12-java11-python3-r-ubuntu
+Tags: 3.4.3-scala2.12-java11-python3-r-ubuntu
Architectures: amd64, arm64v8
-GitCommit: b9f1f8e8ebed1959c2be3864a114b52f67519092
-Directory: 3.4.2/scala2.12-java11-python3-r-ubuntu
+GitCommit: 6f10acb452a360966ec9a971641280b7b4a3619a
+Directory: 3.4.3/scala2.12-java11-python3-r-ubuntu
-Tags: 3.4.2-scala2.12-java11-python3-ubuntu, 3.4.2-python3, 3.4.2
+Tags: 3.4.3-scala2.12-java11-python3-ubuntu, 3.4.3-python3, 3.4.3
Architectures: amd64, arm64v8
-GitCommit: b9f1f8e8ebed1959c2be3864a114b52f67519092
-Directory: 3.4.2/scala2.12-java11-python3-ubuntu
+GitCommit: 6f10acb452a360966ec9a971641280b7b4a3619a
+Directory: 3.4.3/scala2.12-java11-python3-ubuntu
-Tags: 3.4.2-scala2.12-java11-r-ubuntu, 3.4.2-r
+Tags: 3.4.3-scala2.12-java11-r-ubuntu, 3.4.3-r
Architectures: amd64, arm64v8
-GitCommit: b9f1f8e8ebed1959c2be3864a114b52f67519092
-Directory: 3.4.2/scala2.12-java11-r-ubuntu
+GitCommit: 6f10acb452a360966ec9a971641280b7b4a3619a
+Directory: 3.4.3/scala2.12-java11-r-ubuntu
-Tags: 3.4.2-scala2.12-java11-ubuntu, 3.4.2-scala
+Tags: 3.4.3-scala2.12-java11-ubuntu, 3.4.3-scala
Architectures: amd64, arm64v8
-GitCommit: b9f1f8e8ebed1959c2be3864a114b52f67519092
-Directory: 3.4.2/scala2.12-java11-ubuntu
+GitCommit: 6f10acb452a360966ec9a971641280b7b4a3619a
+Directory: 3.4.3/scala2.12-java11-ubuntu
Tags: 3.5.2-scala2.12-java11-python3-r-ubuntu
Architectures: amd64, arm64v8
diff --git a/_bashbrew-list b/_bashbrew-list
index 243d087..13fb4f8 100644
--- a/_bashbrew-list
+++ b/_bashbrew-list
@@ -1,11 +1,11 @@
-spark:3.4.2
-spark:3.4.2-python3
-spark:3.4.2-r
-spark:3.4.2-scala
-spark:3.4.2-scala2.12-java11-python3-r-ubuntu
-spark:3.4.2-scala2.12-java11-python3-ubuntu
-spark:3.4.2-scala2.12-java11-r-ubuntu
-spark:3.4.2-scala2.12-java11-ubuntu
+spark:3.4.3
+spark:3.4.3-python3
+spark:3.4.3-r
+spark:3.4.3-scala
+spark:3.4.3-scala2.12-java11-python3-r-ubuntu
+spark:3.4.3-scala2.12-java11-python3-ubuntu
+spark:3.4.3-scala2.12-java11-r-ubuntu
+spark:3.4.3-scala2.12-java11-ubuntu
spark:3.5.2
spark:3.5.2-java17
spark:3.5.2-java17-python3
diff --git a/_bashbrew-list-build-order b/_bashbrew-list-build-order
index f8be0e0..5d2d659 100644
--- a/_bashbrew-list-build-order
+++ b/_bashbrew-list-build-order
@@ -1,13 +1,13 @@
-spark:3.4.2-scala
-spark:3.4.2-scala2.12-java11-python3-r-ubuntu
+spark:3.4.3-scala
+spark:3.4.3-scala2.12-java11-python3-r-ubuntu
spark:3.5.2-java17-scala
spark:3.5.2-scala2.12-java17-python3-r-ubuntu
spark:4.0.0-preview1-scala
spark:4.0.0-preview1-scala2.13-java17-python3-r-ubuntu
spark:python3-java17
spark:scala
-spark:3.4.2
-spark:3.4.2-r
+spark:3.4.3
+spark:3.4.3-r
spark:3.5.2-java17-r
spark:3.5.2-scala2.12-java11-python3-r-ubuntu
spark:4.0.0-preview1
diff --git a/spark_3.4.2-r/Dockerfile b/spark_3.4.3-r/Dockerfile
similarity index 95%
rename from spark_3.4.2-r/Dockerfile
rename to spark_3.4.3-r/Dockerfile
index ec5015d..58e228e 100644
--- a/spark_3.4.2-r/Dockerfile
+++ b/spark_3.4.3-r/Dockerfile
@@ -14,7 +14,7 @@
# See the License for the specific language governing permissions and
# limitations under the License.
#
-FROM spark:3.4.2-scala2.12-java11-ubuntu
+FROM spark:3.4.3-scala2.12-java11-ubuntu
USER root
diff --git a/spark_3.4.2-scala/Dockerfile b/spark_3.4.3-scala/Dockerfile
similarity index 97%
rename from spark_3.4.2-scala/Dockerfile
rename to spark_3.4.3-scala/Dockerfile
index 2a472f9..b749f07 100644
--- a/spark_3.4.2-scala/Dockerfile
+++ b/spark_3.4.3-scala/Dockerfile
@@ -36,8 +36,8 @@ RUN set -ex; \
# Install Apache Spark
# https://downloads.apache.org/spark/KEYS
-ENV SPARK_TGZ_URL=https://archive.apache.org/dist/spark/spark-3.4.2/spark-3.4.2-bin-hadoop3.tgz \
- SPARK_TGZ_ASC_URL=https://archive.apache.org/dist/spark/spark-3.4.2/spark-3.4.2-bin-hadoop3.tgz.asc \
+ENV SPARK_TGZ_URL=https://archive.apache.org/dist/spark/spark-3.4.3/spark-3.4.3-bin-hadoop3.tgz \
+ SPARK_TGZ_ASC_URL=https://archive.apache.org/dist/spark/spark-3.4.3/spark-3.4.3-bin-hadoop3.tgz.asc \
GPG_KEY=F28C9C925C188C35E345614DEDA00CE834F0FC5C
RUN set -ex; \
diff --git a/spark_3.4.2-scala/entrypoint.sh b/spark_3.4.3-scala/entrypoint.sh
similarity index 100%
rename from spark_3.4.2-scala/entrypoint.sh
rename to spark_3.4.3-scala/entrypoint.sh
diff --git a/spark_3.4.2-scala2.12-java11-python3-r-ubuntu/Dockerfile b/spark_3.4.3-scala2.12-java11-python3-r-ubuntu/Dockerfile
similarity index 96%
rename from spark_3.4.2-scala2.12-java11-python3-r-ubuntu/Dockerfile
rename to spark_3.4.3-scala2.12-java11-python3-r-ubuntu/Dockerfile
index 7c7e96a..a552299 100644
--- a/spark_3.4.2-scala2.12-java11-python3-r-ubuntu/Dockerfile
+++ b/spark_3.4.3-scala2.12-java11-python3-r-ubuntu/Dockerfile
@@ -14,7 +14,7 @@
# See the License for the specific language governing permissions and
# limitations under the License.
#
-FROM spark:3.4.2-scala2.12-java11-ubuntu
+FROM spark:3.4.3-scala2.12-java11-ubuntu
USER root
diff --git a/spark_3.4.2/Dockerfile b/spark_3.4.3/Dockerfile
similarity index 95%
rename from spark_3.4.2/Dockerfile
rename to spark_3.4.3/Dockerfile
index a9fc9e4..03bdaa1 100644
--- a/spark_3.4.2/Dockerfile
+++ b/spark_3.4.3/Dockerfile
@@ -14,7 +14,7 @@
# See the License for the specific language governing permissions and
# limitations under the License.
#
-FROM spark:3.4.2-scala2.12-java11-ubuntu
+FROM spark:3.4.3-scala2.12-java11-ubuntu
USER rootRelevant Maintainers:
|
|
Thank you. Ya, I realized that I also wan't aware of this repo. |
yosifkit
approved these changes
Aug 14, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
https://spark.apache.org/news/spark-3-4-3-released.html
https://github.com/apache/spark-docker/tree/master/3.4.3
I apologize for frequently bothering all of you lately. I am attempting to restore the Docker release history of the Apache Spark 3.4 branch. Fortunately, this will be the last patch for all 3.4.x releases that have not been uploaded.