Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add some custom base and inspection task #49

Merged
merged 1 commit into from
Oct 11, 2023
Merged

Conversation

mafrahm
Copy link
Collaborator

@mafrahm mafrahm commented Oct 11, 2023

Often, it is rather tedious/difficult to inspect the output of some task or the status of the config inst at a certain point of the analysis workflow. To simplify this, three tasks are added with this PR:

  • hbw.ColumnsBaseTask provides a base implementation on how to require columns from reduction, production + ml evaluation combined. It's only a base task, so it cannot be run, but should be inherited of by other tasks.
  • hbw.CheckColumns provides a simple implementation of reading these outputs and checking, which columns are present in each file
  • hbw.CheckConfig only loads the config inst after all the CSP+ML inits have been run and prints some infos. It requires nothing and produces nothing

All three tasks own the typical parameters (selector, producers, ml_models, dataset, ...) and should also resolve defaults+groups as usual.
The hbw.Check* tasks also provide the --debugger parameter, which starts a ipython session at the end of the task.

@mafrahm mafrahm requested a review from apaasch October 11, 2023 14:03
@apaasch apaasch marked this pull request as ready for review October 11, 2023 14:14
@apaasch apaasch merged commit c7c2a25 into master Oct 11, 2023
@mafrahm mafrahm deleted the feature/hbw_base_tasks branch October 12, 2023 10:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants