[SPARK-53693] Publish Apache Spark 3.5.7 to docker registry

[peter-toth]

What changes were proposed in this pull request?

This PR proposes to publish Apache Spark 3.5.7 to docker registry

Why are the changes needed?

To provide a docker image of Apache Spark 3.5.7.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Manual review.

[peter-toth]

@dongjoon-hyun , could you please review this PR?

[dongjoon-hyun]

+1, LGTM.

[peter-toth]

Thank you @dongjoon-hyun.
I kicked off the publish action: https://github.com/apache/spark-docker/actions/runs/17986584977

[peter-toth]

Rerunning the publish action with apache repo: https://github.com/apache/spark-docker/actions/runs/17988981037/job/51174252051

[dongjoon-hyun]

Thank you. I verified the publish images in Apache Spark K8s Operator like the following.

• [SPARK-53702] Update tests to use 4.0.1 and 3.5.7 spark-kubernetes-operator#337

[peter-toth]

Yeah, the images showed up at https://hub.docker.com/r/apache/spark/tags

[peter-toth]

Opened docker-library/official-images#19948 to push them to https://hub.docker.com/_/spark as well.

[peter-toth]

It seems the docker library no longer supports eclipse-temurin:11-jre-focal see docker-library/official-images#19948 (comment).

What shall we do in this case? Switch to 11-jre-jammy or 11-jre-alpine and republish images here and then in docker library again?

cc @dongjoon-hyun

[dongjoon-hyun]

Sorry but I'm not working on docker-library repository because it's non-ASF repo.

Maybe, cc @Yikun since he has been leading docker-library area.

[dongjoon-hyun]

To @peter-toth , please announce 3.5.7 first because non-ASF channel is not a blocker for ASF release process. We can catch up the others later.

[Yikun]

What shall we do in this case? Switch to 11-jre-jammy or 11-jre-alpine

In general, we can just follow the spark repo dockerfile, but I just saw we changed the image to a non-docker official image on apache/spark@25f8a44 .

So that we can follow the ubuntu release version in spark ci at least, it's safe to switch.

[peter-toth]

I opened a PR to switch to 11-jammy: #95