Skip to content

2022 03 05 (Saturday) Deployment

Jump to bottom
jimlerza edited this page Mar 6, 2022 · 3 revisions

General Notes

This deployment consists of the latest batch of work from Flexion. See the bugfixes below.

Bugfixes

Observations

  • Account-specific terraform overwrote the snapshot-access role ARN because it was set up outside of terraform. Will add an OpEx task to define this ARN in terraform and re-deploy.

Timeline

(2022-03-04)

(2022-03-05)

  • 21:16 - Checked account-specific and production environment variables in AWS Secret Manager
  • 21:24 - Ran the account-specific terraform
  • 22:24 - Merged the PR CircleCI Build
  • 22:24 - Tests fail initially due to a missing container image
  • 22:39 - Built a new deployment container and pushed it to ECR
  • 22:40 - Resumed tests
  • 22:48 - Tests pass; deploy step starts
  • 22:51 - Incorrect COGNITO_SUFFIX value defined in production environment variables results in immediate Cognito outage

(2022-03-06)

  • 00:35 - Cognito outage resolved by a build reaching the deploy step with correct COGNITO_SUFFIX defined, but Dynamsoft is still failing the health check
  • 01:48 - Deploy step completes with correct Dynamsoft-related environment variables
  • 02:00 - Readonly Smoketests pass
  • 02:01 - Switched colors
  • 02:14 - Disabled green api mappings api and public-api, east and west

AWS environment configuration

Clone this wiki locally