Migrate to ConfigSpace 1.* #802

motus · 2024-07-17T23:32:25Z

Summary of changes:

Update dependencies to ConfigSpace >= 1.0.
Update dependencies to SMAC3 >= 2.2.
Migrate to new ConfigSpace API.
Better definition of ConfigSpace fixture in unit tests.
Fix mypy and pylint issues triggered by the migration.

Notes:

Side effect: Works with Python 3.12!
~~Supersedes Bump configspace from 0.7.1 to 1.0.1 in /mlos_core #799~~
~~Depends on upcoming SMAC3 release with SMAC3 #1124 merged in and a new release cut with it.~~
Quantization will be added back later:
- Implement quantization for ConfigSpace >= 1.0 #803
~~Tests fail due to LlamaTune issue:~~
- LlamaTune inverse_trainsform() produces invalid configuration #805

Closes #727

…ed to remove them

…/opt/configspace-1.0

mlos_core/setup.py

mlos_bench/mlos_bench/optimizers/convert_configspace.py

bpkroth · 2024-07-22T19:37:27Z

That ConfigSpace update to SMAC was merged, but they haven't cut a new version for us to pull in yet.

…/opt/configspace-1.0

mlos_bench/mlos_bench/tests/tunables/tunable_to_configspace_test.py

mlos_core/mlos_core/optimizers/bayesian_optimizers/smac_optimizer.py

mlos_core/mlos_core/optimizers/flaml_optimizer.py

mlos_core/mlos_core/spaces/adapters/llamatune.py

mlos_core/mlos_core/optimizers/flaml_optimizer.py

mlos_core/setup.py

setup.cfg

bpkroth

Mostly LGTM, just would like to get that quantization support back in asap.

Main remaining question is around the param.to_vector(param.to_vector(...)) transformation. Didn't quite look right, but maybe I'm missing something?

motus · 2024-07-31T23:29:53Z

unit tests seem to break because of #826 - checking it now

conda-envs/mlos-windows.yml

Splitting out from #802 to benefit other jobs as well.

…/opt/configspace-1.0

…s/MLOS into sergiym/opt/configspace-1.0

This PR enables Python 3.12 in Windows environment and does not restrict Python version in the default environments on Windows and Linux. Note that although `mlos-3.12.yml` exists, its usage is still commented out in `linux.yml`, because Python 3.12 is still not available on GitHub CI. Issue #832 opened to track it P.S. Also, we now use a lighter `matplotlib-base` instead of `matplotlib` proper ~To be merged after #802~ --------- Co-authored-by: Brian Kroth <[email protected]>

motus added 9 commits July 15, 2024 17:09

start migration to configspace 1.0

e63f621

migrate a few more calls to 1.0 API

89fa914

proper parameters for NormalIntegerHyperparameter constructor

78186fd

ConfigSpace.Configuration 1.0 validates even inactive parameters - ne…

1bab63e

…ed to remove them

cosmetic fixes

707d995

better fixture for ConfigurationSpace (1.0 compatible)

148b64c

Merge branch 'main' of https://github.com/microsoft/MLOS into sergiym…

9478b49

…/opt/configspace-1.0

black formatting

3edd6c1

remove quantization parameters

341a5ea

motus added dependencies Pull requests that update a dependency file WIP Work in progress - do not merge yet mlos-core mlos-bench labels Jul 17, 2024

motus self-assigned this Jul 17, 2024

motus mentioned this pull request Jul 17, 2024

Implement quantization for ConfigSpace >= 1.0 #803

Closed

use check_valid_configuration() instead of check_configuration()

03970b6

bpkroth reviewed Jul 18, 2024

View reviewed changes

mlos_core/setup.py Show resolved Hide resolved

bpkroth reviewed Jul 18, 2024

View reviewed changes

mlos_core/setup.py Show resolved Hide resolved

bpkroth reviewed Jul 18, 2024

View reviewed changes

mlos_bench/mlos_bench/optimizers/convert_configspace.py Show resolved Hide resolved

This was referenced Jul 19, 2024

Bump configspace from 0.7.1 to 1.1.1 in /mlos_core #808

Closed

Bump configspace from 0.7.1 to 1.0.1 in /mlos_core #799

Closed

Merge branch 'main' into sergiym/opt/configspace-1.0

387f516

bpkroth mentioned this pull request Jul 24, 2024

Bump configspace from 0.7.1 to 1.1.3 in /mlos_core #816

Closed

motus added 3 commits July 24, 2024 17:16

Merge branch 'main' of https://github.com/microsoft/MLOS into sergiym…

2a5b2d2

…/opt/configspace-1.0

update to SMAC3 v 2.2

cf2ad53

use NotSet value for CategoricalHyperparameter default_value

18e42a2

motus marked this pull request as ready for review July 25, 2024 02:14

motus requested a review from a team as a code owner July 25, 2024 02:14

motus removed the WIP Work in progress - do not merge yet label Jul 25, 2024