Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add benchmark and --stats #451

Merged
merged 4 commits into from
Jun 18, 2024
Merged

Add benchmark and --stats #451

merged 4 commits into from
Jun 18, 2024

Conversation

joverlee521
Copy link
Contributor

Description of proposed changes

Add benchmark for all Snakemake rules and use --stats to get more data for #446.

I plan on merging tomorrow morning before the automated workflow runs at ~11am PT.

Related issue(s)

Resolves #240
Gathering stats for #446

Checklist

  • Checks pass

Adding as part of #240 to help collect more data for tackling #446.

One unexpected behavior that I ran into when testing the `--stats`
option is that Snakemake doesn't generate the stats file if the
workflow exits with an error at any step.

Note that the Snakemake `--stats` option is not available starting with
Snakemake v8, so this will need to be removed when we eventually
upgrade Snakemake in our runtimes.
Adding as part of #240 to help collect more data for tackling #446.
The use of `shellquote` was removed in 2dab1f9.
Per Nextstrain's Snakemake style guide, using the `message` directive
overrides the default Snakemake outputs which includes other critical
details.

<https://docs.nextstrain.org/en/latest/reference/snakemake-style-guide.html#avoid-the-message-rule-attribute>
@joverlee521 joverlee521 requested a review from a team June 17, 2024 23:20
@joverlee521 joverlee521 merged commit f5f238b into master Jun 18, 2024
1 check passed
@joverlee521 joverlee521 deleted the benchmarks-stats branch June 18, 2024 16:37
Copy link
Contributor

@huddlej huddlej left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I love benchmarks! +1 for their inclusion in our Snakemake style guide, @joverlee521.

@joverlee521
Copy link
Contributor Author

I love benchmarks! +1 for their inclusion in our Snakemake style guide, @joverlee521.

I merged nextstrain/docs.nextstrain.org#210 yesterday, but it's not available in our latest docs yet because RTD build is currently failing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Profile ncov-ingest
2 participants