Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Add support for driver log as input to profiler to generate unsupported operations detailed report #580

Closed
mattahrens opened this issue Sep 21, 2023 · 2 comments · Fixed by #654
Assignees
Labels
core_tools Scope the core module (scala) feature request New feature or request

Comments

@mattahrens
Copy link
Collaborator

The event log does not have detailed enough information to explain why certain operators (execs/expressions) did not run on GPU for a Spark RAPIDS application. We want to extend the profiler tool to accept a driver log as input and generate a detailed unsupported operations report.

Input: --driverlog file path
Output

  • Name: unsupported_ops.csv
  • Fields: operator, fallback_reason
@mattahrens
Copy link
Collaborator Author

@viadea: let me know if the requirements are acceptable for the profiler accepting driver log as input and generating an unsupported operations report.

@viadea
Copy link
Collaborator

viadea commented Sep 21, 2023

That looks good to me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core_tools Scope the core module (scala) feature request New feature or request
Projects
None yet
3 participants