Sprint 35: Release Report (sprint-34 - sprint-35)

Major accomplishments:

• Fix encoding error in the UI

mrt-dashboard

• a35325f4 2020-04-07 Merge pull request 56 from CDLUC3/mrt284
• ad2d00ea 2020-04-07 add encoding test
• b1427a69 2020-04-07 log encode error in url
• 8c67f5a2 2020-04-06 Support code tests
• ca6b104d 2020-04-06 Update application_controller.rb
• c597e3b8 2020-04-06 catch uri parse error

mrt-tomcat

• d95dcac 2020-04-01 Fix typo
• b90a21d 2020-04-01 Fix war instance

merritt-docker

• d2f7081 2020-04-20 Update README.md
• 8ff50b3 2020-04-20 Update README.md
• b264db5 2020-04-20 docume dev override config files
• 5024a0c 2020-04-14 Update PITCHME.md
• 041594f 2020-04-14 Add minio presentation
• d3cbd68 2020-04-14 Merge pull request 4 from CDLUC3/minio-docker
• 90cfc70 2020-04-13 Update docker-compose.yml
• aea52aa 2020-04-13 add my local alias

mrt-doc

• e027857 2020-04-16 Update presign-obj-by-token.md
• d05e9be 2020-04-09 Update presign-obj.md
• 25a3c5a 2020-04-08 Update presign-obj.md
• c58ad78 2020-04-08 Update presign-obj.md
• a975d9f 2020-04-08 Update presign-obj.md
• 4f223bd 2020-04-07 Update presign-obj.md
• 4d63aea 2020-04-07 Update presign-obj.md
• d554899 2020-04-06 Update presign-file.md
• e13190e 2020-04-06 Update presign-file.md
• 3ff4c34 2020-04-06 Update presign-obj.md

mrt-admin-proto

• 5de03e5 2020-04-01 js/jquery include
• d8fe1e7 2020-03-31 Improved queries
• 3b0ee97 2020-03-31 Update docker-compose.yml
• 5eb4a6a 2020-03-31 Update docker-compose.yml
• 6c58637 2020-03-31 Add query tools

Deployment 2020-04-07: Resolve encoding errors in presigned file requests

Service(s)

• Merritt UI

Release Tickets

• UI: #284

Pull Requests

• CDLUC3/mrt-dashboard#56

Deployment 2020-03-31: Presigned File/ContentType Changes Release

Service(s)

• Storage
• Merritt UI

Release Tickets

• Storage: #278
• UI: #263

Pull Requests

• CDLUC3/mrt-store#5
• CDLUC3/mrt-dashboard#52
• CDLUC3/mrt-dashboard#50
• CDLUC3/mrt-dashboard#48

Sprint 34: Release Report (sprint-33 - sprint-34)

Major accomplishments:

https://github.com/CDLUC3/mrt-doc/issues?q=is%3Aopen+is%3Aissue+label%3A%22Sprint+34%22

• Pre-signed File ContentType fix
• Minio Update SDSC
• Merritt Admin Tool Prototype
  • https://github.com/CDLUC3/mrt-admin-proto
• Containerize Minio for Testing

mrt-dashboard

• 2de6fe58 2020-03-31 Merge pull request 52 from CDLUC3/mrt-264a
• cc4da8ae 2020-03-31 Merge pull request 55 from CDLUC3/mrt-264a1
• 06a629c5 2020-03-26 no_redirect option for dryad
• ee4dd65e 2020-03-23 block rubocall ABC check
• c0b0861d 2020-03-20 fix cov/error handling
• 50dfd634 2020-03-20 improve err/coverage
• 658a1a13 2020-03-20 improve error handling
• 2da33523 2020-03-20 improve error handling
• 48d372be 2020-03-20 improve error msg
• 0900db3d 2020-03-20 refine error handling
• e334e9d4 2020-03-20 rubocop override
• 2ad074c2 2020-03-20 clear up error message
• 000f6175 2020-03-20 Apply patches
• a055a8a2 2020-03-13 Add contentType to presign storage call

mrt-tomcat

• 3650545 2020-03-30 Replic L2 (4 of 4)
• ef72e71 2020-03-26 Replic L2 (3 of 4)
• 020af68 2020-03-26 Replic L2 (2 of 4)
• dc7e589 2020-03-20 Replic prod Linux 2 (1 of 4)
• d0ad04a 2020-03-14 Replic stage Linux 2 (2 of 2)
• 4138a13 2020-03-14 Fix server name
• 5543049 2020-03-14 Replic stage Linux 2 (1 of 2)

merritt-docker

• 512bbbf 2020-03-30 Merge pull request 3 from CDLUC3/minio-docker
• c88fe47 2020-03-26 moount mrt_dashboard code to system
• 625bd1e 2020-03-19 Update commits
• 6ce6894 2020-03-16 update port and commit
• 9f25ae8 2020-03-13 Update docker-compose.yml
• 4075836 2020-03-13 Update docker-compose.yml
• 2f33ef0 2020-03-13 Update docker-compose.yml
• b45de0c 2020-03-13 Update docker-compose.yml
• afaf4b1 2020-03-13 Update use-volume-dryad.yml
• 4611e6e 2020-03-13 create minio container
• 13c5e02 2020-03-13 simplify volume deps

mrt-doc

• 327244d 2020-03-26 Update presign-file.md
• b8774ff 2020-03-26 Update storage-key-file.md
• 06b7892 2020-03-26 Update storage-key-file.md
• 324efd2 2020-03-23 Update presign-file.md
• 00bb8c0 2020-03-18 Update presign-obj-by-token.md
• 00751a6 2020-03-18 Update presign-obj.md
• 8c3e2b7 2020-03-18 Update presign-obj.md
• d175f82 2020-03-18 Update presign-obj.md
• 1e7ace2 2020-03-18 Update presign-obj.md
• 3e7e260 2020-03-18 Update presign-obj.md
• c7c3dfc 2020-03-16 Update presign-obj-by-token.md
• 83d5058 2020-03-13 Update presign-file.md
• b251113 2020-03-12 Create 2020-03-12-presigned-ContentType.md

mrt-store

• f1b7d03 2020-03-19 Merge pull request 5 from CDLUC3/addct
• 041af7e 2020-03-19 Add content-type to presign-file

mrt-cloud

• 501fa8a 2020-03-19 Merge pull request 3 from CDLUC3/addct
• dd7018e 2020-03-19 Add content-type to presign-file

mrt-store-admin

• 91ade66 2020-03-25 add delete for both prod and stage

Deployment 2020-03-10: Presigned File Release Report

Release Ticket

• #257

---

Service(s)

Servers affected

Change Description

Github issue

Link(s) -

Source Code:

Link(s) to tagged release(s) -

Infrastructure Changes to support software (ALB, EFS, etc)

Jenkins: (if applicable)

Build name/number

Build URL

Upgrade Steps (if applicable) - [ ] Action Step 1

Sprint 33: Presigned Release, Release Report (sprint-32 - sprint-33)

Sprint 33: Presigned Release, Release Report (sprint-32 - sprint-33)

Major accomplishments:

https://github.com/CDLUC3/mrt-doc/issues?q=is%3Aopen+is%3Aissue+label%3A%22Sprint+33%22

• Pre-signed file implementation (Storage and UI)
  • UI changes held due to ContentType issue
• Rails module updates
• Linux 2 Audit Cutover
• SDSC Storage Migration Prep
• EFS Setting Refinement
• CloudContainer support in Docker

mrt-dashboard

• b9bae688 2020-03-09 Merge pull request 48 from CDLUC3/mrt-234
• b70aa148 2020-03-09 lostorage rewrite rule
• 57397195 2020-03-06 update limits
• 639d388a 2020-03-06 fix encoder ref
• 22c8612c 2020-03-06 Make encoder static
• bb9d27cd 2020-03-05 code review comments
• 23174902 2020-03-05 return to orig method
• 9b05e42c 2020-03-05 use preferred encode func
• e9372ab2 2020-03-05 Fix encoding
• 6ec18764 2020-03-03 skip file size check
• 1ab930fd 2020-03-03 fix query
• 7f0d18dc 2020-03-03 change to presign url
• dfcc12fa 2020-03-03 update links on version page
• 0ccaf008 2020-03-03 test storage json
• b9940cc8 2020-03-03 update regex tests
• 07fdc8f4 2020-03-03 link to presign
• 2f0350d6 2020-03-03 add comments
• 1a687640 2020-03-02 parse json
• b431a33a 2020-03-02 follow redirect
• 7756e3d2 2020-03-02 follow redirect
• e6dff4a4 2020-03-02 Trailing slash on path
• 0f0aa764 2020-03-02 create static methods
• becacdd8 2020-03-02 Merge branch 'mrt-234' of github.com:CDLUC3/mrt-dashboard into mrt-234
• 0009c1ba 2020-03-02 fix key formatting
• 2ad60d93 2020-02-28 adjust encoding
• 68c50947 2020-02-27 fix perms and path
• 0451a8d4 2020-02-27 Merge pull request 50 from CDLUC3/mrt-234a
• a833da06 2020-02-27 Clean up call to storage service
• ccee47d6 2020-02-27 create storage presign url
• 681fbe52 2020-02-27 Update file_controller.rb
• b8665a98 2020-02-27 add debug
• 4f27ef56 2020-02-26 force 409
• 1536cd09 2020-02-26 rubcop
• 3ef75ac4 2020-02-26 Merge pull request 49 from CDLUC3/mrt-234-debug
• 8c71eef2 2020-02-26 Simplify calls
• 6f2c9af9 2020-02-26 add debug
• 29fc7fe1 2020-02-26 Allow mock of docker urls
• 528c4a9f 2020-02-26 skip auth for key lookup
• 718afd0a 2020-02-26 Update file_controller.rb
• 0235ce32 2020-02-26 Update file_controller.rb
• ee02505f 2020-02-26 Update file_controller.rb
• 1ebe70ad 2020-02-26 update email addresses
• 1a32179c 2020-02-26 fix paths
• 09e03a74 2020-02-26 fix docker container name
• 04c755b8 2020-02-26 rubocop fix
• f24a58a1 2020-02-26 refine mock calls to storage_key func
• 4318b6ba 2020-02-25 fix mock urls
• 9afd247e 2020-02-25 derive dev config from docker
• 37cad754 2020-02-25 add docker env
• 1928216e 2020-02-25 refine test cases
• 477221a4 2020-02-24 fix test cases
• 3568ec69 2020-02-21 use cases for get node/key
• 2173cbde 2020-02-20 change sql - travis test
• 478b5dec 2020-02-20 add from stmt
• 7dadacd9 2020-02-20 remove "as" from sql
• 8f4991df 2020-02-20 fix travis fail in sql
• 4f39fd09 2020-02-19 cleanup tests
• 289d707b 2020-02-19 refine return objects
• ef15290b 2020-02-13 Improve test cases
• ce44e306 2020-02-13 clean up rspec
• 40541c37 2020-02-13 refine spec configuration
• 4b8b829b 2020-02-12 init mock presign
• 10f0e11e 2020-02-12 update email to match rspec
• c114ab84 2020-02-12 config change
• 6150d3ba 2020-02-11 Merge pull request 43 from CDLUC3/dependabot/bundler/loofah-2.3.1
• a7fb06c3 2020-02-11 Merge pull request 46 from CDLUC3/dependabot/bundler/puma-3.12.2
• d4dff67b 2020-02-11 Merge pull request 45 from CDLUC3/dependabot/bundler/rubyzip-1.3.0
• 6f2a014a 2020-02-11 Merge pull request 44 from CDLUC3/dependabot/bundler/nokogiri-1.10.4
• 9b1d28e0 2019-12-06 Bump puma from 3.12.1 to 3.12.2
• 12bb463d 2019-11-18 Bump rubyzip from 1.2.2 to 1.3.0
• 19960ef8 2019-11-08 Bump loofah from 2.2.3 to 2.3.1
• 7952bf5b 2019-11-02 Bump nokogiri from 1.10.1 to 1.10.4

mrt-tomcat

• 7f5625a 2020-03-06 Audit prod Linux 2 (4 of 4)
• 9261713 2020-03-04 Audit prod Linux 2 (3 of 4)
• abeaa0b 2020-03-04 Audit prod Linux 2 (2 of 4)
• 4d718c7 2020-03-03 Update Linux 2 hostname
• e72091e 2020-03-03 Audit prod Linux 2 (1 of 4)
• e5bbe34 2020-02-28 New audit L2 host
• 0c1c40f 2020-02-21 Fix server name
• 4728a8c 2020-02-21 Deployment Audit Stage Linux 2 (1 of 2)

merritt-docker

• 7675b82 2020-03-09 add apache override
• 3ff57f0 2020-03-09 Update Dockerfile
• 833523f 2020-03-09 mail directory
• 2c1d146 2020-03-09 Merge pull request 2 from CDLUC3/mrt-238
• b3d667b 2020-03-09 update commits
• fa2d54f 2020-03-09 lostorage rewrite rule
• 181c4e7 2020-03-06 update commits
• bcde9d6 2020-03-02 update url
• 3059023 2020-02-27 update commit
• cae427f 2020-02-27 update commit
• df6a4bd 2020-02-27 update commit
• fa14563 2020-02-27 update
• 2370456 2020-02-26 update commits
• e80f30e 2020-02-26 docker url base
• 2ecd28f 2020-02-26 Update mrt-dashboard
• f3efe6c 2020-02-26 update url
• c62be05 2020-02-26 container name
• b06f00b 2020-02-26 update ui links
• 69349dc 2020-02-26 update ui commit
• 4386833 2020-02-25 undo
• dc5274e 2020-02-25 Update mock-app_config.yml
• 0bd9dd8 2020-02-25 Update mock-app_config.yml
• 2651671 2020-02-25 use dev
• 915f82d 2020-02-25 readd dev config
• 32d954f 2020-02-25 update branch
• 1b52b1c 2020-02-25 Apply UI changes for presign
• 038f0ab 2020-02-11 update pr commit

mrt-doc

• e7016dc 2020-02-26 Update presign-file.md
• cd5b857 2020-02-19 Merge pull request 252 from CDLUC3/endpoints
• 869c30b 2020-02-19 add status code headers
• fe36bea 2020-02-19 additional error codes
• 2b90af6 2020-02-19 return code details
• 5fffe40 2020-02-19 fix link
• 0534f62 2020-02-19 Merge pull request 251 from CDLUC3/endpoints
• 53efde4 2020-02-19 update endpoint names, move key lookup to ui
• 7418786 2020-02-19 Merge pull request 250 from CDLUC3/endpoints
• df1cb8a 2020-02-19 Implement presign-file in storage as GET

mrt-store

• 84df62a 2020-03-03 Cleanup json
• 56e75ad 2020-02-28 Reset message
• a7f9ab5 2020-02-28 Set json error on startup
• 01b4763 2020-02-26 Return storage properties
• 761027e 2020-02-26 Merge pull request 4 from CDLUC3/presign
• dc94ef1 2020-02-26 Updated messages to latest spec for both OK and errors
• 6fd0481 2020-02-25 Add method definitions for pre-signed
• 45ee30e 2020-02-25 add getPreSigned - Provide access to store-inf.txt properties for signed NodeIO table - return presigned URL included in PreSignedState - set response as simple JSON

mrt-cloud

• f5bd8ce 2020-02-18 Merge pull request 2 from CDLUC3/presigned
• 49d505d 2020-02-18 add getPreSigned - presigned returned from all s3 cloud types - TException.UNIMPLEMENTED_CODE returned from non-s3 cloud types

merritt-docker-prv

• dcba1ac 2020-03-09 Create mrt-ec2.conf
• b4ea68f 2020-03-09 Update store-info-ec2.txt
• fcc16de 2020-03-09 Update README.md
• 180b44f 2020-03-09 lostorage url
• 0b2d75a 2020-03-06 update configs
• 07e27b9 2020-03-02 update url
• a111d52 2020-03-02 fix store url
• c429aec 2020-03-02 update ext ui url
• 4984e93 2020-02-27 Update nodes.txt
• ae4f68b 2020-02-27 sync changes
• 5faa16e 2020-02-26 update store srvr name
• bffe532 2020-02-26 copy app_config
• b9a1b12 2020-02-25 fix yaml
• f41e257 2020-02-25 update env refs
• ce8c35a 2020-02-25 Update app-config-ec2.yml

mrt-conf-prv

• 62db7f6 2020-03-02 Merge pull request 3 from cdlib/docker-nodes
• 8c18077 2020-03-02 Delete nodes-docker.properties
• 4f0f8c7 2020-03-02 Delete nodes-docker-stg.properties
• 90e7e25 2020-03-02 Update nodes-pairtree-docker.properties
• 0dbedc8 2020-02-27 change 7001 to use pair-docker Add wasabi test bucket
• 8ed83cf 2020-02-27 Merge pull request 2 from cdlib/eclipse
• 40397f6 2020-02-27 change 8012 to use pair-docker
• c729c47 2020-02-27 Update .gitignore
• edab6c7 2020-02-27 Return storage properties
• 4f33282 2019-12-17 create .gitignore

Release: Merritt Inventory Linux2 cutover

Service(s)

• Merritt Inventory

Servers affected

• uc3-mrtinv01x2-prd
• uc3-mrtinv02x2-prd

Change Description

Cutover to Linux2 hosts for Merritt Inventory service.

Github issue

#247

Pivotal Tracker issue

https://www.pivotaltracker.com/story/show/170936684

Deployment 2020-01-30: Open Context Redirect Fix Release Report (sprint-30 - )

Service(s)

• Merritt UI

Servers affected

• uc3-mrtui01x2-prd.cdlib.org
• uc3-mrtui02x2-prd.cdlib.org
• uc3-mrtui01x2-prd.cdlib.org

Change Description

Eliminate unnecessary http/https redirects in Merritt UI when retrieving images with the guest login.

Github issue

Link(s) - #128

Source Code:

Link(s) to tagged release(s) -

Infrastructure Changes to support software (ALB, EFS, etc)

Jenkins: (if applicable)

Build name/number

Build URL

Upgrade Steps (if applicable) - [ ] Action Step 1

• Remove hosts one by one from the load balancer and deploy changes. Verified retrievals after the changes were brought back online through the load balancer.

mrt-dashboard

• 33458251 2020-01-30 Merge pull request 42 from CDLUC3/mrt128
• 3e94f3f1 2020-01-13 explicitly call https when utilizing a full path

Sprint 32: Release Report (sprint-31 - sprint-32)

Release Report (sprint-31 - master)

Major Accomplishments

https://github.com/CDLUC3/mrt-doc/issues?q=label%3ASprint32

mrt-dashboard

• 33458251 2020-01-30 Merge pull request 42 from CDLUC3/mrt128
• 3e94f3f1 2020-01-13 explicitly call https when utilizing a full path

mrt-tomcat

• 2feed5f 2020-02-12 Fix error on both L2 hosts
• 8b6fd63 2020-02-10 Remove obsolete
• beefcbb 2020-02-10 Inv prod Linux 2 ( 2 of 2 )
• 0a6b540 2020-02-06 Add Linux 2 Inv (1 of 2)
• 9595825 2020-01-30 Add Inventory Stage Linux 2 Cleanup Linux 1 hosts

merritt-docker

• 58689f9 2020-02-11 update commits

mrt-doc

• 24f77f9 2020-02-13 Merge pull request 231 from CDLUC3/endpoints
• 5ab7948 2020-02-11 Add notes from 2/10 Merritt Team meeting
• 839ec61 2020-02-06 capture review notes
• e1e36b3 2020-02-06 presign-obj-by-token
• b7eeaab 2020-02-06 Update presign obj
• 2b79817 2020-02-06 Add presign object
• 7231155 2020-02-06 Update presign file
• 5209b7b 2020-02-05 fix character
• 161476b 2020-02-05 README note
• 4edcec6 2020-02-05 addit api migration
• 24ce28f 2020-02-05 header update
• c29487a 2020-02-05 A phased header info
• 02d3684 2020-02-05 update method
• 8032e41 2020-02-05 dir rename
• e6f1391 2020-02-05 presign design
• 6527b32 2020-02-05 add presign notes
• 287fe59 2020-02-05 update docs
• fcb52af 2020-02-05 Add enpoint documentation

mrt-conf-prv

• b747ea7 2020-02-18 set nodes-stage to new minio endPoint set node-stg-store to minio from swift
• c352910 2020-02-18 Add change to "unm" node to point on stage to minio content instead of swift
• 13a5841 2020-02-13 Merge pull request 1 from cdlib/wmadd
• 157d248 2020-02-13 Add nodes-prod and nodes_stage to: remove swift, new minio host, cdl wasabi

Sprint 31

Sprint 31: Release Report (sprint-30 - sprint-31)

Major accomplishments:

• https://github.com/CDLUC3/mrt-doc/issues?q=label%3ASprint31

mrt-tomcat

• 1404ed8 2020-01-14 L2 Ingest prod (3 of 3)
• 0d601f5 2020-01-13 Capistrano for new Ingest L2 host
• fb20f76 2020-01-10 Linux 2 Ingest prod (1 of 3)

uc3-etds

• 0af731b 2020-01-28 Updating contact for UCI and UCLA in campus yml

mrt-inventory

• aab94f2 2020-01-24 Add retry logic if 404 occurs on any component extraction

merritt-docker

• ac5327b 2020-01-22 update params
• bcd1aaa 2020-01-22 debug
• f67bba6 2020-01-22 run puma with debug
• cd0ea84 2020-01-22 update submodule
• dd56c41 2020-01-22 update submodule links
• 701e62c 2020-01-22 fix dryad download links
• 755a7df 2020-01-22 comment update
• 4b7c839 2020-01-21 Update README
• 657216f 2020-01-21 Update slides

mrt-ingest

• cb8a01b 2020-01-13 Merge pull request 9 from CDLUC3/revert-8-mrt195-mail-host
• 9efb93c 2020-01-13 Revert "[mrt195] Add debug to confirm setMailHost"
• ee8c47a 2020-01-13 Merge pull request 8 from CDLUC3/mrt195-mail-host
• 6e69a16 2020-01-13 Add debug to confirm setMailHost
• 5485069 2020-01-13 Merge pull request 7 from CDLUC3/mrt195-mail-host
• 4b5cb92 2020-01-13 read mailhost in QueueManager
• f71b0f5 2020-01-13 Merge pull request 6 from CDLUC3/mrt195-mail-host
• 9655a9e 2019-12-17 Merge pull request 5 from CDLUC3/eclipse