Multiple environment MLOps on Azure using Azure DevOps, Azure Machine Learning and Azure Machine Learning Registries
This work-in-progress pull request for the MLOps v2 accelerator looks at incorporating the newly GA Azure Machine Learning registeries to support multi-environment sharing of models, environments and other assets. The current state of the repository is very simple, but the flow can be seen below:
Essentially, this addition now includes registering and sharing a model to a shared Azure ML registry which is then referenced and deployed in a second workspace in-line with the 'model promotion' pattern. There are a few pre-alpha features included i.e. automatically triggering the deployment pipeline based on the completion of the training pipeline and also registering the model into the second workspace as opposed to directly deploying from the registry.
In a similar vain to the MLOps V2 accelerator, documented here, you can clone this repository into your ADO project and work through the files to correspond to your environment set-up.
List of requirements:
- 2 Azure Machine Learning workspaces,
- An Azure Machine Learning registry,
- A compute instance per attendee,
- A shared compute cluster,
- A service principle with
Contributor
access at the subscription level, - An Azure DevOps project,
- A managed identity with the
Azure ML Registry User
role over the Azure Machine Learning registry as well as theContributor
role over both Azure Machine Learning workspaces.
- Improve documentation,
- Re-trigger training based on model monitoring,
- Verify the most appropriate RBAC roles needed.