All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
- Service Catalog AppRegistry resource to register the CloudFormation templates and underlying resources as an application in both Service Catalog AppRegistry and AWS Systems Manager Application Manager.
- AWS Cloud Development Kit (CDK) v2.
- Python runtime 3.10.
- Source code folders structure.
- CDK unit tests.
- Python libraries.
- The S3 bucket policy on the logging S3 bucket to grant access to the logging service principal (logging.s3.amazonaws.com) for access log delivery.
- Python libraries.
- Python runtime 3.9.
- Python libraries.
- Integration with Amazon SageMaker Model Card and Model Dashboard features to allow customers to perform model card operations. All Amazon SageMaker resources (models, endpoints, training jobs, and model monitors) created by the solution will show up on the SageMaker Model Dashboard.
- Missing AWS IAM Role permissions used by the Amazon SageMaker Clarify Model Bias Monitor and Amazon SageMaker Clarify Model Explainability Monitor scheduling jobs.
- The AWS IAM Role permissions with the new naming convention for the temporary Amazon SageMaker endpoints used by the Amazon SageMaker Clarify Model Bias Monitor and Amazon SageMaker Clarify Model Explainability Monitor pipelines.
-
Environment variables of lambda functions by adding
PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION=pythonto handleprotobuflibrary breaking changes in versions greater than3.20.1. -
Empty string image url for the model training pipelines when using Amazon SageMaker Model Registry option.
- A new pipeline to train Machine Learning (ML) models using Amazon SageMaker built-in algorithms and Amazon SageMaker Training Job.
- A new pipeline to train ML models using Amazon SageMaker built-in algorithms and Amazon Hyperparameter Tuning Job.
- A new pipeline to train ML models using Amazon SageMaker built-in algorithms and Amazon SageMaker Autopilot Job.
- Amazon EventBridge Rules to notify the solution's administrator(s) about the status of the training jobs.
- The Amazon Simple Notification Service (SNS) Topic, used for pipelines notifications, was moved to the solution's main template.
- A new pipeline to deploy Amazon SageMaker Clarify Model Bias Monitor. The new pipeline monitors predictions for bias on a regular basis, and generates alerts if bias beyond a certain threshold is detected.
- A new pipeline to deploy Amazon SageMaker Clarify Explainability (Feature Attribution Drift) Monitor. The new pipeline helps data scientists and ML engineers monitor predictions for feature attribution drift on a regular basis.
- The solution's name was changed from "AWS MLOps Framework" to "MLOps Workload Orchestrator".
- Developer section in the Implementation Guide (IG) to explain how customers can integrate their own custom blueprints with the solution.
- Configurable server-side error propagation to allow/disallow detailed error messages in the solution's APIs responses.
- The format of the solution's APIs responses.
- AWS Cloud Development Kit (AWS CDK) and AWS Solutions Constructs to version 1.126.0.
- A new pipeline to deploy Amazon SageMaker Model Quality Monitor. The new pipeline monitors the performance of a deployed model by comparing the predictions that the model makes with the actual ground truth labels that the model attempts to predict.
- The Model Monitor pipeline's API call. Now, the Model Monitor pipeline is split into two pipelines, Data Quality Monitor pipeline, and Model Quality Monitor pipeline.
- The format of CloudFormation templates parameters' names from
PARAMETERNAMEtoParameterName. - The APIs of the Realtime Inference pipeline to support passing an optional custom endpoint name.
- The data quality baseline's Lambda to use AWS SageMaker SDK to create the baseline, instead of using Boto3.
- AWS Cloud Development Kit (AWS CDK) and AWS Solutions Constructs to version 1.117.0.
- The option to use Amazon SageMaker Model Registry to deploy versioned models. The model registry allows you to catalog models for production, manage model versions, associate metadata with models, manage the approval status of a model, deploy models to production, and automate model deployment with CI/CD.
- The option to use an AWS Organizations delegated administrator account to orchestrate the deployment of Machine Learning (ML) workloads across the AWS Organizations accounts using AWS CloudFormation StackSets.
- The build of the AWS Lambda layer for Amazon SageMaker SDK using the lambda:build-python3.8 Docker image.
- Two stack deployment options that provision machine learning (ML) pipelines either in a single AWS account, or across multiple AWS accounts for development, staging/test, and production environments.
- Ability to provide an optional AWS Key Management Service (KMS) key to encrypt captured data from the real-time Amazon SageMaker endpoint, output of batch transform and data baseline jobs, output of model monitor, and Amazon Elastic Compute Cloud (EC2) instance's volume used by Amazon SageMaker to run the solution's pipelines.
- New pipeline to build and register Docker images for custom ML algorithms.
- Ability to use an existing Amazon Elastic Container Registry (Amazon ECR) repository, or create a new one, to store Docker images for custom ML algorithms.
- Ability to provide different input/output Amazon Simple Storage Service (Amazon S3) buckets per pipeline deployment.
- The creation of Amazon SageMaker resources using AWS CloudFormation.
- The request body of the solution's API calls to provision pipelines.
- AWS SDK to use the solution's identifier to track requests made by the solution to AWS services.
- AWS Cloud Development Kit (AWS CDK) and AWS Solutions Constructs to version 1.96.0.
- AWS ECR image scan on push property's name from
scanOnPushtoScanOnPushfor image scanning based on the recently updated property name in AWS CloudFormation. - AWS ECR repository's name in the IAM policy's resource name from
<repository-name>*to*<repository-name>*to accommodate recent repository name being prefixed with AWS CloudFormation stack name.
- Allows you to provision multiple model monitor pipelines to periodically monitor the quality of deployed Amazon SageMaker's ML models.
- Ability to use an existing S3 bucket as the model artifact and data bucket, or create a new one to store model artifact and data.
- Updates AWS Cloud Development Kit (AWS CDK) and AWS Solutions Constructs to version 1.83.0.
- Updates request body of the Pipelines API's calls.
- Initiates a pre-configured pipeline through an API call or a Git repository
- Automatically deploys a trained model and provides an inference endpoint
- Supports running your own integration tests to ensure that the deployed model meets expectations
- Allows to provision multiple environments to support ML model's life cycle
- Notifies users of the pipeline outcome though SMS or email