Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] issues running ray transformations on Google colab #582

Open
1 of 2 tasks
sujee opened this issue Sep 10, 2024 · 2 comments
Open
1 of 2 tasks

[Bug] issues running ray transformations on Google colab #582

sujee opened this issue Sep 10, 2024 · 2 comments
Assignees
Labels
bug Something isn't working

Comments

@sujee
Copy link
Contributor

sujee commented Sep 10, 2024

Search before asking

  • I searched the issues and found no similar issues.

Component

Transforms/universal/ededup

What happened + What you expected to happen

when running this notebook on google colab environment, ededupe step gets stuck with message

(autoscaler +2m35s) Warning: The following resource request cannot be scheduled right now: {'CPU': 0.7}. This is likely due to all cluster resources being claimed by actors. Consider creating fewer actors or adding more nodes to this Ray cluster.

full output : https://gist.github.com/sujee/856b008657793642b08eabe464f3ad96

Reproduction script

https://colab.research.google.com/github/sujee/data-prep-kit-examples/blob/main/dpk-intro/dpk_intro_1.ipynb

Anything else

No response

OS

Other

Python

3.11.x

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!
@sujee sujee added the bug Something isn't working label Sep 10, 2024
@touma-I
Copy link
Collaborator

touma-I commented Sep 10, 2024

@sujee do you think the error is specific to ededup or does it occur for all ray transforms? thanks

@sujee
Copy link
Contributor Author

sujee commented Sep 10, 2024

@sujee do you think the error is specific to ededup or does it occur for all ray transforms? thanks

I think this is more RAY related.

Probably need to investigate

  • if we are creating extra workers
  • or not terminating them correctly

that is maxxing out the cluster resources

@sujee sujee changed the title [Bug] issues running ededupe ray version on Google colab [Bug] issues running ray transformations on Google colab Sep 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants