-
-
Notifications
You must be signed in to change notification settings - Fork 229
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Completely reimplemented the intensifiers (including Successive Halving and Hyperband): All intensifiers support multi-fidelity, multi-objective and multi-threading by nature now. - Expected behaviour for ask-and-tell interface ensured (also for Successive Halving). - Continuing a run is now fully supported. - Added more examples. - Updated documentation based on new implementation. - Added benchmark to compare different versions. Co-authored-by: Sarah Krebs <[email protected]> Co-authored-by: Carolin Benjamins <[email protected]> Co-authored-by: dengdifan <[email protected]> Co-authored-by: helegraf <[email protected]> Co-authored-by: timruhkopf <[email protected]> Co-authored-by: Alexander Tornede <[email protected]> Co-authored-by: Eric Kalosa-Kenyon <[email protected]>
- Loading branch information
1 parent
dd249cd
commit 0a1dff4
Showing
171 changed files
with
14,936 additions
and
8,964 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -143,4 +143,8 @@ dmypy.json | |
docker | ||
|
||
# Others | ||
src | ||
src | ||
|
||
# Pycharm | ||
.idea | ||
.vscode |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
!src |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,22 @@ | ||
# SMAC Benchmark (Beta) | ||
|
||
Calculates multiple tasks for specified versions and compares performance. | ||
Each version is derived from pip and installed in an empty environment (``SMACBenchmark``). | ||
|
||
|
||
## Results | ||
|
||
![trajectory_trials](report/trajectory_walltime.png "Trajectory (Walltime)") | ||
|
||
|
||
## Getting Started | ||
|
||
- Make sure you have anaconda installed. | ||
- Execute ``bash ./run.sh`` inside the benchmark directory. You can specify the versions to run there. | ||
- Have your current version of SMAC installed in the environment ``SMAC``. After the old versions have been finished, the script benchmarks the current version. | ||
- Alternatively, just execute ``python src/benchmark.py`` with a SMAC environment of your choice. | ||
|
||
|
||
## Note | ||
|
||
- Versions before 2.0 might not support the new sklearn (>1.2) anymore |
Oops, something went wrong.