Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Staging -> Master #837

Merged
merged 90 commits into from
Nov 10, 2022
Merged

Staging -> Master #837

merged 90 commits into from
Nov 10, 2022

Commits on Jul 15, 2022

  1. Increase disk size for MakeOptionalBam for Ultima pipeline (#766)

    * increase disk size for MakeOptionalBam
    
    * changelogs and pipeline versions
    
    Co-authored-by: Nikelle Petrillo <[email protected]>
    meganshand and nikellepetrillo committed Jul 15, 2022
    Configuration menu
    Copy the full SHA
    bb16808 View commit details
    Browse the repository at this point in the history
  2. Update WGS README.md (#770)

    ekiernan committed Jul 15, 2022
    Configuration menu
    Copy the full SHA
    b6ff260 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2022

  1. Configuration menu
    Copy the full SHA
    528b2e2 View commit details
    Browse the repository at this point in the history
  2. update plumbing json (#773)

    * Point fingerprinting file keys to publicly available files
    
    * Remove redundant input files from germline single sample pipeline
    timaeusx committed Jul 20, 2022
    Configuration menu
    Copy the full SHA
    b055a88 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2022

  1. rebuild star docker image (#775)

    * Update Skylab STAR Dockerfile to use Alpine Linux image and remove unneeded packages
    
    * Create build script, version file, and readme for STAR Docker image
    
    * Update StarAlign.wdl to use new STAR docker image
    
    * Update changelogs
    
    * Add --platform flag to STAR Dockerfile
    timaeusx committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    78d7199 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2022

  1. Configuration menu
    Copy the full SHA
    56a1282 View commit details
    Browse the repository at this point in the history
  2. Add section to Docker style guide for compiling on M series Macs and …

    …other ARM machines and fix typos (#777)
    timaeusx committed Jul 27, 2022
    Configuration menu
    Copy the full SHA
    cc2fb22 View commit details
    Browse the repository at this point in the history
  3. Migrate Skylab samtools to Broad samtools (#779)

    * Update ValidateATAC.wdl and ValidateSCATAC.wdl to use Broad samtools image
    
    * Remove redundant samtools Dockerfile and directory
    
    * Remove skylab/hca_adapter directory
    timaeusx committed Jul 27, 2022
    Configuration menu
    Copy the full SHA
    2b77797 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2022

  1. Cleanup dropseq_tools related files (#780)

    * Remove unused TagGeneExon.wdl
    
    * Remove dropseq_tools Docker directories and additional files
    timaeusx committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    8f5310d View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2022

  1. Increase memory in fastp and GroupByUMIs tasks (#698)

    Change memory allocation and enable maxRetries in fastp and groupbyUMIs tasks. Temporarily add monitoring scripts to these tasks to monitor memory usage. 
    Update the transcriptome bam to be the RSEM post-processed one.
    Removing tdr_staging_bucket from test file since it is no longer an input
    
    Co-authored-by: M. Morgan Taylor <[email protected]>
    Co-authored-by: Nikelle Petrillo <[email protected]>
    3 people committed Aug 2, 2022
    Configuration menu
    Copy the full SHA
    46b0538 View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2022

  1. Update imputation bcf/vcftools and minimac4 docker images (#787)

    * Update imputation bcf/vcftools and minimac4 docker images
    
    * Update changelogs
    timaeusx committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    27cbd0a View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2022

  1. Rebuild trim adapters docker image (#789)

    * Rewrite TrimAdapters Dockerfile, build script
    * Create TrimAdapters version list, readme
    * Replace TrimAdapters.wdl runtime docker URL with GCR URL
    * Rename trim-adapters to ea-utils, push a new image to GCR, and replace all docker image URLs
    * Update changelog and version number
    * Minor corrections to Minimac4 version list and STAR readme
    timaeusx committed Aug 9, 2022
    Configuration menu
    Copy the full SHA
    8b443fe View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6461d9f View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2022

  1. Configuration menu
    Copy the full SHA
    e77b4a3 View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2022

  1. Update BuildIntervalList to use samtools docker image (#791)

    Remove umi-tools docker directory
    timaeusx committed Aug 11, 2022
    Configuration menu
    Copy the full SHA
    ae70d19 View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2022

  1. Configuration menu
    Copy the full SHA
    c523c7c View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2022

  1. Configuration menu
    Copy the full SHA
    37c3584 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2022

  1. Consolidate Python script dockers into a single docker image (#797)

    * Update Optimus MergeStarOutput task, LoomUtils.wdl tasks to use new pytools docker image
    
    * Standardize paths to scripts in docker image in affected tasks
    
    * Add Docker image files for new pytools docker and reorganize scripts
    
    * Fix print function syntax in scATAC MakeCompliantBAM task
    
    * Update changelogs and version numbers
    
    * Remove old Dockerfiles, build scripts, requirements files
    
    * Revert some changes from #687 in create_snrna_optimus.py to fix a runtime error
    timaeusx committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    ced227a View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2022

  1. Configuration menu
    Copy the full SHA
    7c27b3d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b2ad36b View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2022

  1. Split off BWA docker files from snaptools docker (#799)

    * Create new bwa and snaptools-bwa docker files and documentation
    
    * Build images and replace URLs in tasks
    timaeusx committed Aug 19, 2022
    Configuration menu
    Copy the full SHA
    48febaf View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2022

  1. Pytools related cleanup (#802)

    * Document pytools docker scripts, remove unused create-npz-output.py script and ConvertStarOutput task
    
    * Update changelogs
    timaeusx committed Aug 24, 2022
    Configuration menu
    Copy the full SHA
    55876e9 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2022

  1. Rebuild bcf/vcftools and minimac dockers (#803)

    * Update bcf/vcftools docker files
    timaeusx committed Aug 26, 2022
    Configuration menu
    Copy the full SHA
    432da2b View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2022

  1. update get_changed_pipeline_worklow_test_args.sh (#806)

    * update get_changed_pipeline_worklow_test_args.sh
    
    * Test
    
    * remove Test
    nikellepetrillo committed Aug 29, 2022
    Configuration menu
    Copy the full SHA
    2ab17f5 View commit details
    Browse the repository at this point in the history
  2. update tasks with new docker image, update calls to ingesttotdr task …

    …with additionally added required parameter
    schaluva committed Aug 29, 2022
    Configuration menu
    Copy the full SHA
    b02c639 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2022

  1. KM update WGS pipeline docs (#811)

    * update WGS pipeline docs
    
    * Update README.md
    
    * Update website/docs/Pipelines/Whole_Genome_Germline_Single_Sample_Pipeline/README.md
    
    Co-authored-by: ekiernan <[email protected]>
    kayleemathews and ekiernan committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    102eecf View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2022

  1. Rebuild featureCounts image into a general subread image (#810)

    * Rebuild featureCounts image into a general subread image, add documentation and docker files, and update changelogs and URL in tasks
    timaeusx committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    3ca36b4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a69aa31 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2022

  1. Configuration menu
    Copy the full SHA
    dedba41 View commit details
    Browse the repository at this point in the history
  2. Merge branch 'BroadInternalArraysImputation' of github.com:broadinsti…

    …tute/warp into BroadInternalArraysImputation
    schaluva committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    e688d7f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ff4eae6 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    8a34cc3 View commit details
    Browse the repository at this point in the history
  5. update with new docker

    schaluva committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    08ac5bc View commit details
    Browse the repository at this point in the history
  6. update changelogs'

    schaluva committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    121804d View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    6ad46b9 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    eca1b9a View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    df21621 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    3ef3c5e View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    2e475f9 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    f68efe9 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2022

  1. Configuration menu
    Copy the full SHA
    6c76d75 View commit details
    Browse the repository at this point in the history
  2. remove call to trigger PRS

    schaluva committed Sep 3, 2022
    Configuration menu
    Copy the full SHA
    3ebe184 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ecbf83a View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    8b33257 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2022

  1. Update tasks using plain ubuntu images to use alpine (#813)

    * Update tasks using ubuntu images to use alpine-bash and update changelogs
    timaeusx committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    e46294a View commit details
    Browse the repository at this point in the history
  2. Add troubleshooting note to docker directory readme file (#814)

    * Add troubleshooting/standalone run instructions to docker directory readme file
    timaeusx committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    d228be3 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    1e0eba4 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    d996689 View commit details
    Browse the repository at this point in the history
  5. Merge branch 'BroadInternalArraysImputation' of github.com:broadinsti…

    …tute/warp into BroadInternalArraysImputation
    schaluva committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    e41f1e3 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    a60a96d View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    0faf67c View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    87625f0 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    37039e7 View commit details
    Browse the repository at this point in the history
  10. update with new docker

    schaluva committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    148b5eb View commit details
    Browse the repository at this point in the history
  11. update changelogs'

    schaluva committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    e104f95 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    6ebb61d View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    beef899 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    bb93aeb View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    e9d5295 View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    c68a2fd View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    b22a006 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    153b381 View commit details
    Browse the repository at this point in the history
  19. remove call to trigger PRS

    schaluva committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    6884ab2 View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    1a31f39 View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    54d02dd View commit details
    Browse the repository at this point in the history
  22. Merge branch 'BroadInternalArraysImputation' of github.com:broadinsti…

    …tute/warp into BroadInternalArraysImputation
    schaluva committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    c1431f1 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2022

  1. update change logs

    schaluva committed Sep 7, 2022
    Configuration menu
    Copy the full SHA
    9a81ecd View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    137b57c View commit details
    Browse the repository at this point in the history
  3. Merge pull request #808 from broadinstitute/BroadInternalArraysImputa…

    …tion
    
    update tasks with new docker image, update calls to ingesttotdr task …
    schaluva committed Sep 7, 2022
    Configuration menu
    Copy the full SHA
    81e3897 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    d7e439c View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2022

  1. add the skylab tests to the pr tests/nightly tests (#816)

    *run all pipelines in smart tests
    nikellepetrillo committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    d8a0315 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6adc30d View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2022

  1. GL-2053: Rebuild HISAT2 docker (#821)

    * Create new docker files and update tasks and changelogs
    timaeusx committed Sep 12, 2022
    Configuration menu
    Copy the full SHA
    8cd05da View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2022

  1. Build new RSEM docker image, supporting files, and update tasks, chan…

    …gelogs, and version numbers (#822)
    timaeusx committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    bec74de View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2022

  1. GL-2059: Update testing UI in Jenkins (#824)

    * Correct test string and update testing framework script
    timaeusx committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    2834d0e View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2022

  1. change from dockerhub to gcr

    schaluva committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    2ce31b0 View commit details
    Browse the repository at this point in the history
  2. update changelogs

    schaluva committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    b6ee9b8 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2022

  1. GL-2003: Remove /cromwell_root/ prefix in UGWGG task output file paths (

    #829)
    
    * Remove /cromwell_root/ prefix in file paths and update changelogs
    timaeusx committed Sep 21, 2022
    Configuration menu
    Copy the full SHA
    8856e37 View commit details
    Browse the repository at this point in the history
  2. GL-2017: Docker directory consistency improvements and general cleanup (

    #827)
    
    * Consistency and formatting improvements
    
    * Update some tasks to use rebuilt images
    
    * Update changelogs
    timaeusx committed Sep 21, 2022
    Configuration menu
    Copy the full SHA
    83c3ab7 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    1d040da View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2022

  1. GL-2055: Updated Build_indices container and Fixes on corresponding W…

    …DL (#830)
    
    * Checkpoint. Renamed the package and made modifications based on recommendations in Warp's docker style guide. Local build currently fails even without modifications, currently investigating why.
    
    * Modifications based on WARP's docker style guide
    
    * Updated to conform to the docker style guide of warp. Also upgraded to a more recent Debian version (Bullseye) so tini is part of apt. An upgrade of python was attempted too but pip failed as it can't find old versions of libraries listed in requirements.txt.
    
    * Parameterizing STAR version.
    
    * Adding build script
    
    * Updating build script to push to GCR.
    
    * Changed the WDL to utilize the new container.
    
    * Changing biotypes type from String to File so it localizes.
    
    * Fixing the PATH, rebuilding the container, then setting the WDL to use the new build.
    
    * Ran into an error where STAR was looking for a fasta file that didn't exist. This fixes that error.
    
    * Added Readme for the container.
    
    * Updated changelog and version.
    
    * Changing the list of versions to match the other containers' format
    kevinpalis committed Sep 22, 2022
    Configuration menu
    Copy the full SHA
    1ddba6a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    26853dc View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2022

  1. Configuration menu
    Copy the full SHA
    53f18ad View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c8f2a9c View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2022

  1. Configuration menu
    Copy the full SHA
    a876f97 View commit details
    Browse the repository at this point in the history
  2. update arrays changelog

    schaluva committed Sep 30, 2022
    Configuration menu
    Copy the full SHA
    cc4f741 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    cd0eb6e View commit details
    Browse the repository at this point in the history
  4. update changelogs

    schaluva committed Sep 30, 2022
    Configuration menu
    Copy the full SHA
    bc3b8a3 View commit details
    Browse the repository at this point in the history
  5. Merge pull request #828 from broadinstitute/emerge_gcr_images

    BroadInternalArrays and BroadInternalImputation: change docker from dockerhub to gcr
    schaluva committed Sep 30, 2022
    Configuration menu
    Copy the full SHA
    70317fc View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2022

  1. Merge pull request #834 from broadinstitute/develop

    dev -> staging
    nikellepetrillo committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    e30bd74 View commit details
    Browse the repository at this point in the history