Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Start versioning benchmark specificiation notebooks using Zenodo DOI #1515

Open
wd15 opened this issue Aug 16, 2023 · 2 comments
Open

Start versioning benchmark specificiation notebooks using Zenodo DOI #1515

wd15 opened this issue Aug 16, 2023 · 2 comments

Comments

@wd15
Copy link
Collaborator

wd15 commented Aug 16, 2023

Ideas here is to use the Zenodo versioning to version our benchmarks rather than use our arbitrary fallible system. We submit each notebook to Zenodo and then update the same series of data with the new notebook when changes are made. Each version of the notebook will have a DOI and also there will be a DOI associated with all the versions.

The submission schema in pfhub-schema should point at the version DOI as well as having human readable benchmark number + zenodo version number. Benchmark versions are 1a.zenodo_doi, but mostly referred to as 1a for example. Get rid of the 1a.0 1a.1 etc. It's just confusing for people

Authors should be based on those that have edited the notebook and had names on the paper associated with the benchmark.

How to cite this benchmark should be at the top of each benchmark notebook

@wd15 wd15 added this to the April 2024 Meeting milestone Aug 16, 2023
@wd15
Copy link
Collaborator Author

wd15 commented Aug 16, 2023

@tkphd: what do you think?

@tkphd
Copy link
Collaborator

tkphd commented Aug 16, 2023

Sounds like a better approach than we're currently using. I like it!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants