Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Profile tool - Add integration tests for processing driver log #658

Open
2 tasks
nartal1 opened this issue Nov 14, 2023 · 0 comments
Open
2 tasks
Assignees
Labels
core_tools Scope the core module (scala) feature request New feature or request

Comments

@nartal1
Copy link
Collaborator

nartal1 commented Nov 14, 2023

Is your feature request related to a problem? Please describe.
This is a followon of PR-#654 . We added unit test in that PR for processing driver log and verifying unsupported operators are generated as expected. This issue to add integration tests to verify processing of driver log on different platforms.

  • Generate driver logs for some queries(NDS) on different platforms(OnPrem, databricks, dataproc).
  • Write integration tests to verify the --driverlog arguments on above generated logs produces expected results. i.e compare the results of generated csv results with the expected results. This is similar to the current integration tests which we have for testing eventlogs.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core_tools Scope the core module (scala) feature request New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants