Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

consolidate: allow using existing manifest as a cache #46

Open
ES-Alexander opened this issue Apr 28, 2023 · 0 comments
Open

consolidate: allow using existing manifest as a cache #46

ES-Alexander opened this issue Apr 28, 2023 · 0 comments

Comments

@ES-Alexander
Copy link
Collaborator

Consolidation already takes quite a while, and it's generally unlikely that existing tags will have changed labels or a changed structure. The default behaviour should be to use the existing manifest file as a cache, and only fetch data for new tags, with the option to instead do a clean/full refresh and generate the entire file from scratch.

Something like a --cache command-line argument could be useful, where

  • if unspecified it uses the latest online manifest
  • if "none" it does a full refresh
  • if given a URL it tries to fetch it and use it, erroring out on failure to fetch
  • if given a local filename it tries to read it and use it, erroring out on failure to read

This should save a bunch of consolidation time, and also reduce unnecessary API usage.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant