Skip to content

TEZ-4653: Upgrade commons-io to the latest 2.22.0 - #541

Open
sercanCyberVision wants to merge 1 commit into
apache:masterfrom
sercanCyberVision:TEZ-4653
Open

sercanCyberVision wants to merge 1 commit into
apache:masterfrom
sercanCyberVision:TEZ-4653

Conversation

@sercanCyberVision

Copy link
Copy Markdown
Contributor

SOLUTION
Upgraded commons-io from 2.16.0 to 2.22.0, the latest version available at the moment.

CHECKS
Dependency tree before the upgrade:

> mvn dependency:tree -Dincludes=commons-io:* | grep 'commons-io:commons-io'
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO] \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]       \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile
[INFO]    \- commons-io:commons-io:jar:2.16.0:compile

Dependency tree after the upgrade:

> mvn dependency:tree -Dincludes=commons-io:* | grep 'commons-io:commons-io'
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO] \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]       \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile
[INFO]    \- commons-io:commons-io:jar:2.22.0:compile

Verified that both Tez distributions contain the upgraded dependency:

> ll tez-dist/target/tez-1.0.0-SNAPSHOT/lib/ | grep commons-io
-rw-r--r-- 1  609182 Jan  9  2026 commons-io-2.22.0.jar
> ll tez-dist/target/tez-1.0.0-SNAPSHOT-minimal/lib/ | grep commons-io
-rw-r--r-- 1  609182 Jan  9  2026 commons-io-2.22.0.jar

Basic functionality test with Hive 4.2.1:

hive> CREATE TABLE test (id INT);
Time taken: 1.276 seconds
hive> INSERT INTO test VALUES (1);
Total jobs = 1
Launching Job 1 out of 1
Status: Running (Executing on YARN cluster with App id application_1790085661540_0001)
----------------------------------------------------------------------------------------------
        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
----------------------------------------------------------------------------------------------
Map 1 .......... container     SUCCEEDED      1          1        0        0       0       0  
Reducer 2 ...... container     SUCCEEDED      1          1        0        0       0       0  
----------------------------------------------------------------------------------------------
VERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 5.49 s     
----------------------------------------------------------------------------------------------
Loading data to table default.test
Time taken to move files:	 0 ms
StatsTask took 206
Time taken: 7.473 seconds
hive>

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 5m 44s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 💚 mvninstall 5m 0s master passed
+1 💚 compile 4m 2s master passed
+1 💚 javadoc 1m 32s master passed
_ Patch Compile Tests _
+1 💚 mvninstall 3m 47s the patch passed
+1 💚 codespell 1m 35s No new issues.
+1 💚 compile 4m 3s the patch passed
+1 💚 javac 4m 3s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 javadoc 1m 26s the patch passed
_ Other Tests _
+1 💚 unit 77m 40s root in the patch passed.
+1 💚 asflicense 0m 56s The patch does not generate ASF License warnings.
107m 8s
Subsystem Report/Notes
Docker ClientAPI=1.56 ServerAPI=1.56 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-541/1/artifact/out/Dockerfile
Optional Tests dupname compile unit asflicense javac javadoc codespell detsecrets xmllint
uname Linux 9f13d8fe1d57 5.15.0-190-generic #200-Ubuntu SMP Fri Aug 7 15:06:04 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality tez-personality.sh
git revision master / 0e9f756
Default Java Eclipse Adoptium-21.0.12+8-LTS
Test Results https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-541/1/testReport/
Max. process+thread count 1505 (vs. ulimit of 5500)
modules C: . U: .
Console output https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-541/1/console
versions git=2.43.0 maven=3.9.15 codespell=2.4.1
Powered by Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants