Skip to content

Releases: CDLUC3/mrt-doc

Deployment 2022-03-21: UI Release

31 Mar 00:05
3d0f87a
Compare
Choose a tag to compare

Deployment 2022-03-17: Inventory fix – Replication tables not updated for objects that are modified

31 Mar 00:04
3d0f87a
Compare
Choose a tag to compare

Deployment 2022-03-14: Ingest build refactor and Dependabot updates

31 Mar 00:02
3d0f87a
Compare
Choose a tag to compare

Sprint 67: Release Report (sprint-66 - sprint-67)

10 Mar 01:29
207b89e
Compare
Choose a tag to compare

Major accomplishments:

  • Inventory Locking mechanism deployed to prevent concurrent Storage operations
  • Audit and Ingest migration to new build pipelines on Stage
  • Manifest validation tool made available (core lib validation checking next)
  • New Docker workspace config made available for development environments
  • New UCI collections established

mrt-doc sprint-66-main..sprint-67-main

mrt-inventory sprint-66..sprint-67

  • c4b0950 2022-02-23 Merge pull request 11 from CDLUC3/zkLock
  • 7f290c7 2022-02-23 - Ingest and Inventory will share Locking queue - Change lock location

mrt-ingest sprint-66-main..sprint-67-main

  • 2aade37 2022-03-07 Merge pull request 43 from CDLUC3/java-refactor
  • d0bebbc 2022-03-07 Expose build information in static/ dir
  • 5d9dc5d 2022-03-03 Merge pull request 38 from CDLUC3/java-refactor
  • 564a201 2022-03-03 Merge branch 'main' into java-refactor
  • 4a126d8 2022-03-03 Default to use "main" branch for core2
  • 908dd6d 2022-03-02 Address as many Github dependabot issues as possible
  • 1b9056f 2022-02-25 Remove obsolete command line functionality
  • 5e0b4b3 2022-02-25 Remove old JARGS library reference
  • 3b543bf 2022-02-25 Remove DataONE library references
  • de67ea3 2022-02-23 use groovy module
  • fa969c5 2022-01-20 branch or tag name
  • 49656aa 2022-01-20 override settings.xml
  • 502a764 2022-01-20 comment change
  • f82267e 2022-01-19 create tagname file
  • d2c9fa0 2022-01-19 typo
  • dcac294 2022-01-19 add build details
  • fec19a5 2022-01-19 upd clone branch
  • b479bcf 2022-01-19 use checkout task
  • a913cf1 2022-01-19 mod branch name
  • 442cb8e 2022-01-19 switch git command
  • ffb766e 2022-01-19 add echo around m2 purge
  • 3f52e62 2022-01-19 update if cond
  • 3354bd7 2022-01-19 conditional remove of local m2
  • 31cd15b 2022-01-19 artifacts
  • 88dda5f 2022-01-19 update arch list
  • 281d64f 2022-01-19 update artifact list
  • 913d398 2022-01-19 tag v branch
  • 01214ee 2022-01-19 git tag
  • 7591048 2022-01-19 fix m2local refs
  • 2059ce5 2022-01-19 purge m2local
  • 5b999ba 2022-01-19 use tagname
  • a55621a 2022-01-18 update jenkinsfile - ws
  • 88f0766 2022-01-18 add jenkinsfile
  • 98c010f 2022-01-18 whitespace change
  • 05ddbaf 2022-01-07 pom again
  • 1439db0 2022-01-07 undo pom change
  • 28b1d84 2022-01-07 deps
  • fa6a9d8 2022-01-07 format pom
  • 6af83a2 2022-01-04 tidy pom file
  • 31c1563 2022-01-03 attempt to mod build

File-Analyzer sprint-66-main..sprint-67-main

  • 4e0584e 2022-03-09 readmen update
  • 5e45923 2022-03-09 856a
  • b01a186 2022-03-09 Merge pull request 3 from CDLUC3/etd
  • eb07523 2022-03-09 init funct
  • 6026c6a 2022-03-09 isbn or bib
  • 2049d8c 2022-03-09 etdlookup

merritt-docker sprint-66-main..sprint-67-main

  • e8c4fd7 2022-03-08 git Merge branch 'java-refactor'
  • ad45e61 2022-03-08 tidy build deps
  • be8a2af 2022-03-07 reflect commit changes and branch name
  • 5ef8c6c 2022-03-07 Merge pull request 28 from CDLUC3/opensearch
  • fba47f3 2022-03-07 tweek READM smor
  • 98bb502 2022-03-07 java-refacter: clean up docs prior to merge
  • dd85bca 2022-03-03 Need Central and Nexus repos
  • c72f179 2022-03-03 opensearch: update submodules from remotes
  • 90855f4 2022-03-03 Merge branch 'java-refactor' into opensearch
  • d66d023 2022-03-03 opensearch: merge ec2.yml into docker-compose.yml
  • 28735df 2022-03-03 opensearch: primare merritt micro-services are indexing. Sweet!
  • 74fea7e 2022-03-02 opensearch: got gelf log-driver to work with logstash
  • 6fd77ef 2022-03-02 opensearch: getting filebeat to work
  • 5b9b661 2022-03-01 update submodules
  • 636776d 2022-03-01 Merge branch 'opensearch' of github.com:CDLUC3/merritt-docker into opensearch
  • 7bb0be4 2022-03-01 README is ready for peer review
  • 74b7e4f 2022-03-01 same
  • b117f86 2022-02-28 same
  • 27b8d5a 2022-02-28 syntax errors in README
  • 792a897 2022-02-28 and more rewrite of README. what the hell...
  • f5b1a0e 2022-02-28 still updating README. Finally finished submodule doc
  • c13b575 2022-02-25 java-refactor: still updating the bloody readme
  • 280f65c 2022-02-24 java-refactor: still updating README
  • 0dbc122 2022-02-23 commit updates
  • 02353eb 2022-02-18 opensearch: tweek filebeat configs
  • b391344 2022-02-18 update submodule dryad-app
  • 03127eb 2022-02-18 java-refactor: still revising readme
  • 681937d 2022-02-17 java-refactor: still revising REAMDE
  • 4b60327 2022-02-16 java-refactor: revising README
  • a060cab 2022-02-15 Merge branch 'java-refactor.ashley' into opensearch
  • 5ce9137 2022-02-15 java-refactor: update README new install instructions
  • e14cd5f 2022-02-15 opensearch: add docker-compose scriptlets
  • 3de2148 2022-02-15 Merge branch 'java-refactor.ashley' into opensearch
  • 0893c05 2022-02-15 Merge branch 'java-refactor.ashley' into opensearch
  • fced4b0 2022-02-15 Merge branch 'java-refactor.ashley' of github.com:CDLUC3/merritt-docker into java-refactor.ashley
  • e3d9ffa 2022-02-15 java-refactor: tweek dep_build.sh s'mor
  • 169b861 2022-02-15 java-refactor: make mrt-integ-tests a submodule
  • 37f3791 2022-02-14 java-refactore: tweeking workspace init script
  • c0aaf07 2022-02-14 java-refacter: add new init script
  • ef26e62 2022-02-14 java-refacter: dep_build.sh is nice now
  • 4eb6686 2022-02-14 refactering dep_build process
  • c9c86ba 2022-02-14 java-refactor: add branch info for all submodules
  • 672c9a7 2022-02-14 Merge branch 'opensearch' of github.com:CDLUC3/merritt-docker into opensearch
  • 8ef3a0c 2022-02-14 opensearch: update README
  • 504b52c 2022-02-14 upd branch refresh
  • 8bccf57 2022-02-14 opensearch: tweeking opensearch.yml
  • e392fde 2022-02-14 opensearch: refactoring merritt-docker build scripts
  • f95071b 2022-02-11 opensearch: got filebeat working
  • af0bd48 2022-02-11 opensearch: create 4 containers for opensearch stack
  • 931f902 2022-01-20 update commits and dockerfiles
  • d7669d8 2022-01-11 doc update
  • 4e3cb9f 2022-01-05 build args and tag names
  • 8d0cc82 2022-01-05 elim mrt-dependencies directory
  • f64d99f 2022-01-05 oai and sword
  • 3cfde84 2022-01-05 tidy script and cdlmvn dockerfile
  • 20ff781 2022-01-05 update commit
  • 1351e09 2022-01-05 update commit
  • dcf3e65 2022-01-05 update commit
  • 6e644c7 2022-01-05 build core services w/o oai and sword
  • 5a262d3 2022-01-04 update dockerfiles
  • af11343 2022-01-03 commit updates
  • 25e0d5b 2021-12-20 additional build deps
  • 7e41611 2021-12-14 stash docker build work
  • 70f7957 2021-12-10 first refactor
  • a8dd392 2021-12-10 ecr compose

mrt-repo-tagger sprint-66-main..sprint-67-main

  • ca8d5f7 2022-03-04 Update config.yml
  • 21a41c0 2022-02-23 Update config.yml

Deployment 2022-02-28: Inventory Lock support

10 Mar 01:10
207b89e
Compare
Choose a tag to compare

Sprint 66: Release Report (sprint-65 - sprint-66)

17 Feb 04:49
aa0978d
Compare
Choose a tag to compare

Major accomplishments:

  • Ingest lock to prevent concurrent storage operations
  • Replic and Inventory database updates to support tracking timings
  • Good progress on cloud scan review and object corrections
  • Admin and Coll admin documentation completed
  • UCM video deposits completed
  • Approximately 400 UC Davis ETDs processed

mrt-doc sprint-65-main..sprint-66-main

  • aa0978d 2022-02-16 Update sprint-log.md with Sprint 67 goals
  • d266c84 2022-02-16 Add req field checks
  • fccccf6 2022-02-16 Add more use cases
  • d4b21c8 2022-02-11 check for req fields
  • 5975622 2022-02-11 fix profile name
  • c8db909 2022-02-11 document select
  • c328bb5 2022-02-11 update manifest tools
  • 6141ddc 2022-02-10 fix manifest
  • cd8807a 2022-02-10 manifest prototype
  • 302b6d3 2022-02-07 Add rollback instructions
  • 6870ecc 2022-02-07 fix font issues
  • 26baffc 2022-02-07 arial
  • 3fd1cf6 2022-02-07 arial
  • 14f59df 2022-02-07 verdana default
  • 6837255 2022-02-07 set def to verdanta
  • 6be6cf6 2022-02-03 latest mermaid

mrt-inventory sprint-65..sprint-66

  • 9e6aa18 2022-02-11 Merge pull request 10 from CDLUC3/zkLock
  • 2b69b01 2022-02-11 Release lock in case of 404 for manifest (overlapping storage/inv concurrency)
  • dcc1d7e 2022-02-11 Merge pull request 9 from CDLUC3/zkLock
  • 2bb589c 2022-02-10 Lock support

mrt-ingest sprint-65-main..sprint-66-main

  • afd79f9 2022-02-15 Merge pull request 42 from CDLUC3/adminLock
  • 4b1a4db 2022-02-15 Close session explicitly when making requeue or delete queue requests
  • 7752f34 2022-02-01 Merge pull request 41 from CDLUC3/adminLock
  • d9b3841 2022-02-01 Support for Lock API

mrt-replic sprint-65..sprint-66

  • b9870f7 2022-02-10 do not write audit records to db if node copy fails
  • 35b8663 2022-01-28 Remove 2ndary call to storage if 404 on cloud access

mrt-cloud sprint-65..sprint-66

  • d4c668d 2022-02-09 do retry on meta call if non-404 exception

mrt-core2 sprint-65..sprint-66

  • 93f17b1 2022-02-01 Merge pull request 11 from CDLUC3/ingestLock
  • 7fdd10a 2022-02-01 Support Ingest lock state info

cdl-zk-queue sprint-65..sprint-66

  • b7d9dbf 2022-02-08 Merge pull request 9 from CDLUC3/zkLock
  • 7a8b940 2022-02-08 Must explicitly close zookeeper object to remove sessions (and tcp connection)
  • 307e69e 2022-02-03 Merge pull request 8 from CDLUC3/zkLock
  • a13e14a 2022-02-03 Fix typo
  • 1fa502c 2022-02-03 Merge pull request 7 from CDLUC3/zkLock
  • 552efdd 2022-02-03 Catch ZK ConnectionLoss exception for Locks and retry 3 times
  • 4b568c2 2022-02-01 Merge pull request 6 from CDLUC3/zkLock
  • c48a142 2022-02-01 Create more support for ZK Locks

mrt-admin-lambda sprint-65-main..sprint-66-main

  • 239c258 2022-02-11 Admin Tool report description edits
  • 05a2702 2022-02-11 Add Inventory lock SSM doc
  • 2a6a3d4 2022-02-09 fix lock screen display
  • 7bb5033 2022-02-09 audit status update
  • 025e2d2 2022-02-08 repl fail report
  • cff2a11 2022-02-08 total replic in prog
  • cd111b1 2022-02-07 Merge pull request 47 from CDLUC3/lockdetails
  • 5436295 2022-02-07 tidy descriptions
  • aaab796 2022-02-07 fix typo
  • 45813d5 2022-02-07 Update report descriptions
  • 792310f 2022-02-07 update rep defs, retire wasabi report
  • 1566d57 2022-02-07 report def descriptions
  • ea6acbe 2022-02-03 lock details
  • a97c2b7 2022-02-02 Add Ingest Lock API docs
  • d27ff29 2022-01-26 Update repl queries
  • 68d150f 2022-01-26 Merge branch 'replcol' of github.com:CDLUC3/mrt-admin-lambda into replcol
  • 9dc232a 2022-01-25 rpt update
  • 28385c7 2022-01-25 rpt update

mrt-cron sprint-65-main..sprint-66-main

  • 15331a4 2022-02-09 Update reports.yml
  • cfe3e68 2022-02-08 add replic_failed
  • 82ea148 2022-02-08 enable con_versions

mrt-dashboard-config sprint-65..sprint-66

  • 9bca57f 2022-01-28 New Nuxeo feed - UCI Critical Theory - Ticket 917

Deployment 2022-02-15: Ingest concurrency lock for Storage, including new API endpoints

17 Feb 01:28
Compare
Choose a tag to compare

#906
Note that this change was first released on 2022-02-10, but was rolled back on 2022-02-12. Hotfixes were deployed to production on 2022-02-14 and 2022-02-15.

Deployment 2022-02-14: Replic - Block Audit write on fail

17 Feb 01:25
Compare
Choose a tag to compare

Deployment 2022-02-11: Replic - Fix for failed Wasabi updates

17 Feb 01:23
Compare
Choose a tag to compare

Deployment 2022-02-07: Replic and Inv updates for tracking replication timings