Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding a split utility to support data splitting -- enables key AIX36… #35

Merged
merged 1 commit into from
Jul 30, 2021

Conversation

raghukiran1224
Copy link
Contributor

AIX360 enabled usecase for parallelism;

Adding an example notebook to demo the capability in action with AIX360's SHAP explainer

Related Issue

Supports #33

Related PRs

N/A

This PR is not dependent on any other PR

What does this PR do?

This PR adds a split functionality that breaks the data into smaller chunks by user controlled splits. This enables scaling out of comptue intensive tasks using CodeFlare.

Description of Changes

Added a split function in utils along with a test. Some minor newlines etc for other files. Also a notebook to showcase the functionality of split in the context of AIX360 to accelerate explanations.

What gif most accurately describes how I feel towards this PR?

Example of a gif

…0 usecase for parallelism; Adding an example notebook to demo the capability in action with AIX360's SHAP explainer
@raghukiran1224 raghukiran1224 added enhancement New feature or request cfp-runtime Codeflare pipelines runtime cfp-examples Examples Pri0 High priority, needs imediate attention labels Jul 30, 2021
@raghukiran1224 raghukiran1224 requested a review from mudhakar July 30, 2021 21:04
Copy link
Contributor

@mudhakar mudhakar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Local explainer in AIX 360 parallelized on Ray

@raghukiran1224 raghukiran1224 merged commit a2b290a into develop Jul 30, 2021
@raghukiran1224 raghukiran1224 deleted the splitter branch July 30, 2021 21:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cfp-examples Examples cfp-runtime Codeflare pipelines runtime enhancement New feature or request Pri0 High priority, needs imediate attention
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants