-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Convert to new split pipeline approach for CI/CD (#278)
* new split pipelines * specify channel * fix pip jq install * fixes and cleanup * add new lines * add docs and clean up naming * use shared image * rename * strip quotes from location * fix env var * remove succeeded condition * remove extra deploy yml * no pr trigger * remove unused template * remove unused pipeline * add more docs and add to bootstrap * linting * fix model package to show logs * Squashed commit of the following: commit 01af8da Author: j-so <[email protected]> Date: Fri Jun 12 14:15:35 2020 -0700 fixed failure handling commit 1e6f906 Author: j-so <[email protected]> Date: Fri Jun 12 14:03:09 2020 -0700 test failed conda dep commit a8030d7 Author: j-so <[email protected]> Date: Fri Jun 12 13:55:00 2020 -0700 test package fail commit c7845aa Author: j-so <[email protected]> Date: Fri Jun 12 13:46:27 2020 -0700 fail on deploy error' * Squashed commit of the following: commit 5af6eeb Author: j-so <[email protected]> Date: Mon Jun 15 18:31:15 2020 -0700 fix bootstrap commit f61e103 Merge: 2796b40 08bb6f4 Author: j-so <[email protected]> Date: Mon Jun 15 18:30:21 2020 -0700 Merge branch 'master' into jenns/splitpipeline_docfix commit 2796b40 Author: j-so <[email protected]> Date: Mon Jun 15 18:30:00 2020 -0700 remove old pipeline commit 08bb6f4 Author: David Tesar <[email protected]> Date: Mon Jun 15 14:09:12 2020 -0700 Simplify docs flow (#297) commit cd762ec Author: jotaylo <[email protected]> Date: Mon Jun 15 12:28:23 2020 -0700 Move instruction to install AML extension to Azure Devops setup instructions (#298) * remove need for model build id * fix batch scoring * use model version for batch scoring * linting * Squashed commit of the following: commit 493ed3e Author: j-so <[email protected]> Date: Mon Jun 22 16:42:07 2020 -0700 mark as output commit 1ca7a59 Author: j-so <[email protected]> Date: Mon Jun 22 16:12:10 2020 -0700 fix import commit 743e301 Author: j-so <[email protected]> Date: Mon Jun 22 15:59:43 2020 -0700 more fixes commit 44abcac Author: j-so <[email protected]> Date: Mon Jun 22 15:50:49 2020 -0700 fix batch scoring * improve the docs * fix secret access * pass to cli task and impove naming
- Loading branch information
Showing
23 changed files
with
456 additions
and
295 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,161 @@ | ||
| # Continuous Integration (CI) pipeline that orchestrates the deployment of the diabetes_regression model. | ||
|
|
||
| # Runtime parameters to select artifacts | ||
| parameters: | ||
| - name : artifactBuildId | ||
| displayName: Model Train CI Build ID. Default is 'latest'. | ||
| type: string | ||
| default: latest | ||
|
|
||
| pr: none | ||
|
|
||
| # Trigger this pipeline on model-train pipeline completion | ||
| trigger: none | ||
| resources: | ||
| containers: | ||
| - container: mlops | ||
| image: mcr.microsoft.com/mlops/python:latest | ||
| pipelines: | ||
| - pipeline: model-train-ci | ||
| source: Model-Train-Register-CI # Name of the triggering pipeline | ||
| trigger: | ||
| branches: | ||
| include: | ||
| - master | ||
|
|
||
| variables: | ||
| - template: diabetes_regression-variables-template.yml | ||
| - group: devopsforai-aml-vg | ||
|
|
||
| stages: | ||
| - stage: 'Deploy_ACI' | ||
| displayName: 'Deploy to ACI' | ||
| condition: variables['ACI_DEPLOYMENT_NAME'] | ||
| jobs: | ||
| - job: "Deploy_ACI" | ||
| displayName: "Deploy to ACI" | ||
| container: mlops | ||
| timeoutInMinutes: 0 | ||
| steps: | ||
| - download: none | ||
| - template: diabetes_regression-get-model-id-artifact-template.yml | ||
| parameters: | ||
| projectId: '$(resources.pipeline.model-train-ci.projectID)' | ||
| pipelineId: '$(resources.pipeline.model-train-ci.pipelineID)' | ||
| artifactBuildId: ${{ parameters.artifactBuildId }} | ||
| - task: AzureCLI@1 | ||
| displayName: 'Install AzureML CLI' | ||
| inputs: | ||
| azureSubscription: '$(WORKSPACE_SVC_CONNECTION)' | ||
| scriptLocation: inlineScript | ||
| workingDirectory: $(Build.SourcesDirectory) | ||
| inlineScript: 'az extension add -n azure-cli-ml' | ||
| - task: AzureCLI@1 | ||
| displayName: "Deploy to ACI (CLI)" | ||
| inputs: | ||
| azureSubscription: '$(WORKSPACE_SVC_CONNECTION)' | ||
| scriptLocation: inlineScript | ||
| workingDirectory: $(Build.SourcesDirectory)/$(SOURCES_DIR_TRAIN)/scoring | ||
| inlineScript: | | ||
| set -e # fail on error | ||
| az ml model deploy --name $(ACI_DEPLOYMENT_NAME) --model '$(MODEL_NAME):$(MODEL_VERSION)' \ | ||
| --ic inference_config.yml \ | ||
| --dc deployment_config_aci.yml \ | ||
| -g $(RESOURCE_GROUP) --workspace-name $(WORKSPACE_NAME) \ | ||
| --overwrite -v | ||
| - task: AzureCLI@1 | ||
| displayName: 'Smoke test' | ||
| inputs: | ||
| azureSubscription: '$(WORKSPACE_SVC_CONNECTION)' | ||
| scriptLocation: inlineScript | ||
| inlineScript: | | ||
| set -e # fail on error | ||
| export SUBSCRIPTION_ID=$(az account show --query id -o tsv) | ||
| python -m ml_service.util.smoke_test_scoring_service --type ACI --service "$(ACI_DEPLOYMENT_NAME)" | ||
| - stage: 'Deploy_AKS' | ||
| displayName: 'Deploy to AKS' | ||
| dependsOn: Deploy_ACI | ||
| condition: and(succeeded(), variables['AKS_DEPLOYMENT_NAME']) | ||
| jobs: | ||
| - job: "Deploy_AKS" | ||
| displayName: "Deploy to AKS" | ||
| container: mlops | ||
| timeoutInMinutes: 0 | ||
| steps: | ||
| - template: diabetes_regression-get-model-id-artifact-template.yml | ||
| parameters: | ||
| projectId: '$(resources.pipeline.model-train-ci.projectID)' | ||
| pipelineId: '$(resources.pipeline.model-train-ci.pipelineID)' | ||
| artifactBuildId: ${{ parameters.artifactBuildId }} | ||
| - task: AzureCLI@1 | ||
| displayName: 'Install AzureML CLI' | ||
| inputs: | ||
| azureSubscription: '$(WORKSPACE_SVC_CONNECTION)' | ||
| scriptLocation: inlineScript | ||
| workingDirectory: $(Build.SourcesDirectory) | ||
| inlineScript: 'az extension add -n azure-cli-ml' | ||
| - task: AzureCLI@1 | ||
| displayName: "Deploy to AKS (CLI)" | ||
| inputs: | ||
| azureSubscription: '$(WORKSPACE_SVC_CONNECTION)' | ||
| scriptLocation: inlineScript | ||
| workingDirectory: $(Build.SourcesDirectory)/$(SOURCES_DIR_TRAIN)/scoring | ||
| inlineScript: | | ||
| set -e # fail on error | ||
| az ml model deploy --name $(AKS_DEPLOYMENT_NAME) --model '$(MODEL_NAME):$(MODEL_VERSION)' \ | ||
| --compute-target $(AKS_COMPUTE_NAME) \ | ||
| --ic inference_config.yml \ | ||
| --dc deployment_config_aks.yml \ | ||
| -g $(RESOURCE_GROUP) --workspace-name $(WORKSPACE_NAME) \ | ||
| --overwrite -v | ||
| - task: AzureCLI@1 | ||
| displayName: 'Smoke test' | ||
| inputs: | ||
| azureSubscription: '$(WORKSPACE_SVC_CONNECTION)' | ||
| scriptLocation: inlineScript | ||
| inlineScript: | | ||
| set -e # fail on error | ||
| export SUBSCRIPTION_ID=$(az account show --query id -o tsv) | ||
| python -m ml_service.util.smoke_test_scoring_service --type AKS --service "$(AKS_DEPLOYMENT_NAME)" | ||
| - stage: 'Deploy_Webapp' | ||
| displayName: 'Deploy to Webapp' | ||
| condition: variables['WEBAPP_DEPLOYMENT_NAME'] | ||
| jobs: | ||
| - job: "Deploy_Webapp" | ||
| displayName: "Package and deploy model" | ||
| container: mlops | ||
| timeoutInMinutes: 0 | ||
| steps: | ||
| - template: diabetes_regression-get-model-id-artifact-template.yml | ||
| parameters: | ||
| projectId: '$(resources.pipeline.model-train-ci.projectID)' | ||
| pipelineId: '$(resources.pipeline.model-train-ci.pipelineID)' | ||
| artifactBuildId: ${{ parameters.artifactBuildId }} | ||
| - template: diabetes_regression-package-model-template.yml | ||
| parameters: | ||
| modelId: $(MODEL_NAME):$(MODEL_VERSION) | ||
| scoringScriptPath: '$(Build.SourcesDirectory)/$(SOURCES_DIR_TRAIN)/scoring/score.py' | ||
| condaFilePath: '$(Build.SourcesDirectory)/$(SOURCES_DIR_TRAIN)/conda_dependencies.yml' | ||
| - script: echo $(IMAGE_LOCATION) >image_location.txt | ||
| displayName: "Write image location file" | ||
| - task: AzureWebAppContainer@1 | ||
| name: WebAppDeploy | ||
| displayName: 'Azure Web App on Container Deploy' | ||
| inputs: | ||
| azureSubscription: '$(AZURE_RM_SVC_CONNECTION)' | ||
| appName: '$(WEBAPP_DEPLOYMENT_NAME)' | ||
| resourceGroupName: '$(RESOURCE_GROUP)' | ||
| imageName: '$(IMAGE_LOCATION)' | ||
| - task: AzureCLI@1 | ||
| displayName: 'Smoke test' | ||
| inputs: | ||
| azureSubscription: '$(WORKSPACE_SVC_CONNECTION)' | ||
| scriptLocation: inlineScript | ||
| inlineScript: | | ||
| set -e # fail on error | ||
| export SUBSCRIPTION_ID=$(az account show --query id -o tsv) | ||
| python -m ml_service.util.smoke_test_scoring_service --type Webapp --service "$(WebAppDeploy.AppServiceApplicationUrl)/score" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.