Skip to content

Conversation

@chenghuichen
Copy link
Contributor

@chenghuichen chenghuichen commented Feb 19, 2025

Purpose

Linked issue: close #40

Provide optional built-in Hadoop dependencies to simplify usage and enable testing scenarios.

Tests

No.

API and Format

While no object APIs are modified, this change affects _PYPAIMON_HADOOP_CLASSPATH environment variable:

  • When set to a specific path -> Uses user-specified Hadoop jars
  • When not set -> Automatically uses built-in Hadoop jars

This change maintains backward compatibility while providing a more user-friendly default behavior.

Documentation

It would be better to update Doc too.

Copy link
Contributor

@yuzelin yuzelin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@yuzelin yuzelin merged commit 0be8175 into apache:main Mar 21, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Enhancement] Provide Optional Built-in Hadoop Dependencies

2 participants