Skip to content

cloudera/Model-Hub

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Jenkins jobs used in the Modelhub operations.

  1. mlx_concat_model_hub_yamls

    Description: Job to concatenate individual YAML files under a release directory to generate a single YAML file which can be used in airgapped installations to generate ModelHub cards

    URL : https://master-01.jenkins.cloudera.com/job/mlx_concat_model_hub_yamls/

    Parameters:

    1. PLATFORM : Private or Public based on which paltform's individual modelhub catalog YAML files needs to be merged.
    2. MLX_CRUD_APP_MAJOR_VERSION : Major version of MLX_CRUD_APP (like 1.51.0 and NOT 1.51.0-b133) for which individual modelhub catalog YAML files needs to be merged.

    How does the job work:

    1. Based on the PLATFORM and MLX_CRUD_APP_MAJOR_VERSION individual files will be merged into a single YAML file and will be stroed under https://github.com/cloudera/Model-Hub/tree/main/models/airgapped/.
    2. The naming convention of the concatenated file will be <MLX_CRUD_APP_MAJOR_VERSION>_concatenated.yaml
  2. mlx_copy_modelhub_spec

    Description: Job to push ModelHub changes to mlx-crud-app repo. A few customers might have restriction on accessing external github repositires so the mlx-crud-app will use the modelhub catalog files from local repo instead of external github repo. We use this job to keep both external github and mlx-crud-app master branch to be in sync.

    URL: https://master-01.jenkins.cloudera.com/job/mlx_copy_modelhub_spec/

    Parameters:

    1. DSE_TICKET: DSE ticket number corresponding to this copy operation
    2. PLATFORM: Private or Public for which the modelhub catalog files needs to be synced in mlx-crud-app
    3. MLX_CRUD_APP_MAJOR_VERSION: Major version of MLX_CRUD_APP (like 1.51.0 and NOT 1.51.0-b133) for which modelhub catalog YAML files needs to be copied.

    How does the job work: For the choosen platform the job will copy over all the content from Model-Hub github repo to Cloudera's mlx-crud-app repo. Any changes in the YAML files will be directly merged to master branch of mlx-crud-app repo.

    Note

    1. YAML files for a chosen platform will be copied over to master branch of mlx-crud-app. If needed we need to cherry-pick the commit to release branch.
  3. mlx_copy_modelhub_manifest_to_model_registry

    Description: Job to push changes in model-registry manifest to model-registry repo. We use this job to keep both external github and model-registry manifest master branch to be in sync.

    URL: https://master-01.jenkins.cloudera.com/job/mlx_copy_modelhub_manifest_to_model_registry/

    Parameters:

    1. registyVersion: model registry version for which manifest YAML files needs to be copied.

    How does the job work: For the choosen registyVersion the job will copy over all the content from Model-Hub/manifest/registyVersion github repo to Cloudera's model-registry repo. Any changes in the YAML files will be directly merged to master branch of mlx-crud-app repo.

Note 1. YAML files will be copied over to master branch of mlx-crud-app. If needed we need to cherry-pick the commit to release branch.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •  

Languages