Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature: design of experiment pipelining #113

Open
jdreo opened this issue Dec 18, 2021 · 0 comments
Open

Feature: design of experiment pipelining #113

jdreo opened this issue Dec 18, 2021 · 0 comments
Assignees
Labels

Comments

@jdreo
Copy link
Contributor

jdreo commented Dec 18, 2021

IOHexperimenter should have simple workflows for answering the following question: "is my solver better than state of the art?".

This requires an automated experimental pipeline: run an algorithm configuration to tune the solver's parameter, then estimate its performances on a benchmark (with optional cross-validation).
To be as simple as possible, this experimental pipeline should be able to run seamlessly on an HPC cluster, without much intervention from the user.

A good way to do that would be to use modern workflow managers, like SnakeMake or Nextflow, or implement the design of experiment through openMole.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants