Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Checksum flag #95

Merged
merged 7 commits into from
Feb 22, 2024
Merged

Checksum flag #95

merged 7 commits into from
Feb 22, 2024

Conversation

yashpatel6
Copy link
Collaborator

Description

Adding functionality to skip checksum validation through environment variables. The checksum generation gets long in runtime for very large files so adding the option to skip checksum validation as needed.


Test Results

Tested with pytest with added tests


Checklist

File Commits

  • This PR does NOT contain Protected Health Information (PHI). A repo may need to be deleted if such data is uploaded.
    Disclosing PHI is a major problem1 - Even a small leak can be costly2.

  • This PR does NOT contain germline genetic data3, RNA-Seq, DNA methylation, microbiome or other molecular data4.

  • This PR does NOT contain other non-plain text files, such as: compressed files, images (e.g. .png, .jpeg), .pdf, .RData, .xlsx, .doc, .ppt, or other output files.

  To automatically exclude such files using a .gitignore file, see here for example.

Code Review Best Practices

  • I have read the code review guidelines and the code review best practice on GitHub check-list.

  • I have set up or verified the main branch protection rule following the github standards before opening this pull request.

  • The name of the branch is meaningful and well formatted following the standards, using [AD_username (or 5 letters of AD if AD is too long)]-[brief_description_of_branch].

  • I have added the major changes included in this pull request to the CHANGELOG.md under the next release version or unreleased, and updated the date.

Testing

  • I have added unit tests for the new feature(s).

  • I modified the integration test(s) to include the new feature.

  • All new and previously existing tests passed locally and/or on the cluster.

  • The docker image built successfully on the cluster.

Footnotes

  1. UCLA Health reaches $7.5m settlement over 2015 breach of 4.5m patient records

  2. The average healthcare data breach costs $2.2 million, despite the majority of breaches releasing fewer than 500 records.

  3. Genetic information is considered PHI.
    Forensic assays can identify patients with as few as 21 SNPs

  4. RNA-Seq, DNA methylation, microbiome, or other molecular data can be used to predict genotypes (PHI) and reveal a patient's identity.

pipeval/common.py Show resolved Hide resolved
pipeval/common.py Show resolved Hide resolved
@yashpatel6 yashpatel6 merged commit f9adeae into main Feb 22, 2024
1 check passed
@yashpatel6 yashpatel6 deleted the yashpatel-checksum-disabling-option branch February 22, 2024 20:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants