Jenkins jobs used in the Modelhub operations.
-
mlx_concat_model_hub_yamls
Description: Job to concatenate individual YAML files under a release directory to generate a single YAML file which can be used in airgapped installations to generate ModelHub cards
URL : https://master-01.jenkins.cloudera.com/job/mlx_concat_model_hub_yamls/
Parameters:
- PLATFORM : Private or Public based on which paltform's individual modelhub catalog YAML files needs to be merged.
- MLX_CRUD_APP_MAJOR_VERSION : Major version of MLX_CRUD_APP (like 1.51.0 and NOT 1.51.0-b133) for which individual modelhub catalog YAML files needs to be merged.
How does the job work:
- Based on the PLATFORM and MLX_CRUD_APP_MAJOR_VERSION individual files will be merged into a single YAML file and will be stroed under https://github.com/cloudera/Model-Hub/tree/main/models/airgapped/.
- The naming convention of the concatenated file will be <MLX_CRUD_APP_MAJOR_VERSION>_concatenated.yaml
-
mlx_copy_modelhub_spec
Description: Job to push ModelHub changes to mlx-crud-app repo. A few customers might have restriction on accessing external github repositires so the mlx-crud-app will use the modelhub catalog files from local repo instead of external github repo. We use this job to keep both external github and mlx-crud-app master branch to be in sync.
URL: https://master-01.jenkins.cloudera.com/job/mlx_copy_modelhub_spec/
Parameters:
- DSE_TICKET: DSE ticket number corresponding to this copy operation
- PLATFORM: Private or Public for which the modelhub catalog files needs to be synced in mlx-crud-app
- MLX_CRUD_APP_MAJOR_VERSION: Major version of MLX_CRUD_APP (like 1.51.0 and NOT 1.51.0-b133) for which modelhub catalog YAML files needs to be copied.
How does the job work: For the choosen platform the job will copy over all the content from Model-Hub github repo to Cloudera's mlx-crud-app repo. Any changes in the YAML files will be directly merged to master branch of mlx-crud-app repo.
Note
- YAML files for a chosen platform will be copied over to master branch of mlx-crud-app. If needed we need to cherry-pick the commit to release branch.
-
mlx_copy_modelhub_manifest_to_model_registry
Description: Job to push changes in model-registry manifest to model-registry repo. We use this job to keep both external github and model-registry manifest master branch to be in sync.
URL: https://master-01.jenkins.cloudera.com/job/mlx_copy_modelhub_manifest_to_model_registry/
Parameters:
- registyVersion: model registry version for which manifest YAML files needs to be copied.
How does the job work: For the choosen registyVersion the job will copy over all the content from Model-Hub/manifest/registyVersion github repo to Cloudera's model-registry repo. Any changes in the YAML files will be directly merged to master branch of mlx-crud-app repo.
Note 1. YAML files will be copied over to master branch of mlx-crud-app. If needed we need to cherry-pick the commit to release branch.