add some custom base and inspection task #49
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Often, it is rather tedious/difficult to inspect the output of some task or the status of the config inst at a certain point of the analysis workflow. To simplify this, three tasks are added with this PR:
hbw.ColumnsBaseTask
provides a base implementation on how to require columns from reduction, production + ml evaluation combined. It's only a base task, so it cannot be run, but should be inherited of by other tasks.hbw.CheckColumns
provides a simple implementation of reading these outputs and checking, which columns are present in each filehbw.CheckConfig
only loads the config inst after all the CSP+ML inits have been run and prints some infos. It requires nothing and produces nothingAll three tasks own the typical parameters (selector, producers, ml_models, dataset, ...) and should also resolve defaults+groups as usual.
The hbw.Check* tasks also provide the
--debugger
parameter, which starts a ipython session at the end of the task.