Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] User qualification tool does not support cluster properties file with autoscaling worker nodes #624

Closed
cindyyuanjiang opened this issue Oct 19, 2023 · 0 comments · Fixed by #647
Closed

[BUG] User qualification tool does not support cluster properties file with autoscaling worker nodes #624

cindyyuanjiang opened this issue Oct 19, 2023 · 0 comments · Fixed by #647
Assignees
@cindyyuanjiang
Labels
bug Something isn't working user_tools Scope the wrapper module running CSP, QualX, and reports (python)

Comments

@cindyyuanjiang
Copy link
Collaborator

cindyyuanjiang commented Oct 19, 2023 •
edited
Loading

Describe the bug
User qualification tool throws RuntimeError for input cluster properties file that has autoscaling worker nodes on databricks-azure platform.

The user qualification tool is complaining that there is no worker nodes as below:

RuntimeError: Invalid cluster: The cluster has no worker nodes.
	It is recommended to define a with (1 master, N workers).

Steps/Code to reproduce bug
Run the user qualification tool with --cpu_cluster argument which represents an autoscaling cluster.

Expected behavior
User qualification tool should work for autoscaling cpu clusters.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@cindyyuanjiang cindyyuanjiang

Labels
bug Something isn't working user_tools Scope the wrapper module running CSP, QualX, and reports (python)
Projects
None yet
Milestone
No milestone
2 participants
@mattahrens @cindyyuanjiang