Skip to content

HIVE-29552: Add docker scripts for Ozone#6414

Merged
ayushtkn merged 4 commits intoapache:masterfrom
ayushtkn:HIVE-29552
Apr 9, 2026
Merged

HIVE-29552: Add docker scripts for Ozone#6414
ayushtkn merged 4 commits intoapache:masterfrom
ayushtkn:HIVE-29552

Conversation

@ayushtkn
Copy link
Copy Markdown
Member

@ayushtkn ayushtkn commented Apr 7, 2026

What changes were proposed in this pull request?

Add a way to run Hive with Ozone as backend storage

Why are the changes needed?

For using Ozone in Hive in Docker env

Does this PR introduce any user-facing change?

No

How was this patch tested?

Deployed locally

cd packaging/src/docker 
export HIVE_VERSION=4.2.0
mvn dependency:copy -Dartifact="org.postgresql:postgresql:42.5.1" && \
export POSTGRES_LOCAL_PATH=`mvn help:evaluate -Dexpression=settings.localRepository -q -DforceStdout`/org/postgresql/postgresql/42.5.1/postgresql-42.5.1.jar 
./start-hive.sh --ozone 
image
docker exec -it hiveserver2 beeline -u 'jdbc:hive2://localhost:10000/'

Created Tables

create table emp(id int) stored by iceberg;
insert into emp values (1),(2),(3),(4)

Verified data is in Ozone
image

Ozone Shell
image

@abstractdog
Copy link
Copy Markdown
Contributor

abstractdog commented Apr 8, 2026

thanks @ayushtkn, looks very good so far!

it worked with:

./start-hive.sh --ozone

also tried with:

./start-hive.sh --ozone --llap

but I hit this below:
ozone_llap_failure.log

is there a chance you can make this work easily? having ozone in the fully distributed (--llap) mode would be awesome
I don't necessarily want to block this initiative for that (thinking of a follow-up ticket), but there is hope that you can make it work 💪 🚀

@ayushtkn
Copy link
Copy Markdown
Member Author

ayushtkn commented Apr 8, 2026

Thanx @abstractdog for the review. I have added changes for LLAP
image

LLAP_SHUFFLE_PORT: '15551'

DEFAULT_FS: "${DEFAULT_FS}"
HADOOP_CLASSPATH: /opt/hadoop/share/hadoop/tools/lib/*
Copy link
Copy Markdown
Contributor

@abstractdog abstractdog Apr 9, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

HADOOP_CLASSPATH is not needed here as in the entrypoint, classpath is defined as $HADOOP_HOME/share/hadoop/tools/lib/*
I tried it without this, worked

Copy link
Copy Markdown
Contributor

@abstractdog abstractdog left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

one minor comment, other than that this looks good to me +1
feel free to merge this you agree with my comment and fixed it

@sonarqubecloud
Copy link
Copy Markdown

sonarqubecloud bot commented Apr 9, 2026

@ayushtkn ayushtkn merged commit 350c4d4 into apache:master Apr 9, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants