New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[GLUTEN-8653][CORE] Bump Spark to 3.5.4 #8597

Draft

jackylee-ch wants to merge 1 commit into apache:main from jackylee-ch:bump_spark_3.5.4

+48 −35

Contributor

jackylee-ch commented Jan 23, 2025

What changes were proposed in this pull request?

Support Spark 3.5.4

How was this patch tested?

GA

jackylee-ch marked this pull request as draft

January 23, 2025 07:31

github-actions bot added CORE INFRA TOOLS DOCS labels

github-actions bot commented Jan 23, 2025

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/apache/incubator-gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

Other pull requests

github-actions bot commented Jan 23, 2025

Run Gluten Clickhouse CI on x86

Contributor

zhouyuan commented Jan 26, 2025

we may need to wait for a new release with this commit:
apache/iceberg@dbfefb0

jackylee-ch force-pushed the bump_spark_3.5.4 branch from 05b828b to 2f4261b Compare

January 30, 2025 14:24

github-actions bot commented Jan 30, 2025

Run Gluten Clickhouse CI on x86

jackylee-ch force-pushed the bump_spark_3.5.4 branch from 2f4261b to 1616aae Compare

February 1, 2025 13:03

github-actions bot commented Feb 1, 2025

Run Gluten Clickhouse CI on x86

jackylee-ch force-pushed the bump_spark_3.5.4 branch from 1616aae to ad99573 Compare

February 2, 2025 10:11

github-actions bot commented Feb 2, 2025

Run Gluten Clickhouse CI on x86

jackylee-ch force-pushed the bump_spark_3.5.4 branch from ad99573 to a62af4c Compare

February 2, 2025 13:53

github-actions bot added the VELOX label

github-actions bot commented Feb 2, 2025

Run Gluten Clickhouse CI on x86

jackylee-ch force-pushed the bump_spark_3.5.4 branch from a62af4c to 086ba7e Compare

February 2, 2025 14:03

github-actions bot commented Feb 2, 2025

Run Gluten Clickhouse CI on x86


          [DNM] Bump Spark to 3.5.4

5dc70e7

jackylee-ch force-pushed the bump_spark_3.5.4 branch from 086ba7e to 5dc70e7 Compare

February 3, 2025 03:30

github-actions bot commented Feb 3, 2025

Run Gluten Clickhouse CI on x86

jackylee-ch changed the title ~~[DNM] Bump Spark to 3.5.4~~ [GLUTEN-8653][CORE] Bump Spark to 3.5.4

github-actions bot commented Feb 3, 2025

FelixYBW reviewed

View reviewed changes

pom.xml

@@ @@ -335,7 +335,7 @@ @@
                     <properties>
                       <sparkbundle.version>3.5</sparkbundle.version>
                       <sparkshim.artifactId>spark-sql-columnar-shims-spark35</sparkshim.artifactId>
-                      <spark.version>3.5.2</spark.version>
+                      <spark.version>3.5.4</spark.version>
                       <iceberg.version>1.5.0</iceberg.version>

Contributor

FelixYBW Feb 5, 2025

Change the iceberg version here?

Contributor Author

jackylee-ch Feb 6, 2025

Yes. However, iceberg has not released version 1.7.2 yet. Iceberg 1.7.2 have a bugfix related to Spark 3.5.4, this PR needs to wait until iceberg 1.7.2 is released.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CORE DOCS INFRA TOOLS VELOX