Get HPO working again

[dinogun]

1. Use EmailMessage as cgi is deprecated
2. Dockerfile should use python3 instead of python39
3. Add missing source script
4. Updated OS image
5. Use quay.io repo instead of DockerHub

[bharathappali]

@dinogun I see scripts scripts/cluster-helpers.sh & scripts/openshift-helpers.sh are shown as empty files in the commits. Is it because of file permission changes?

[bharathappali]

Also will it be a good idea to use a lightweight framework like fastapi instead of using a basic http server for rest_service.py?

Fast API :

• Website
• Github
• Docs

[kusumachalasani]

Works as expected across all environments. Tested on native,docker,openshift.

[kusumachalasani]

There are some future warnings with HPO related to tunables. It would be good to address them as well later to prevent potential issues down the line.

hpo/hpo/src/bayes_optuna/optuna_hpo.py:389: FutureWarning: suggest_discrete_uniform has been deprecated in v3.0.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v3.0.0. Use suggest_float(..., step=...) instead.
  tunable_value = trial.suggest_discrete_uniform(
hpo/hpo/src/bayes_optuna/optuna_hpo.py:393: FutureWarning: suggest_int() got {'step'} as positional arguments but they were expected to be given as keyword arguments.
  tunable_value = trial.suggest_int(

[kusumachalasani]

LGTM!

[dinogun]

@bharathappali Reg fastapi, we can do those as a separate PR if needed. Right now just want to fix what is broken

[bharathappali]

Reg fastapi, we can do those as a separate PR if needed

I completely agree, Will raise an issue to keep track of it. Thanks @dinogun