Skip to content

Stop paused crawl after time limit #2576

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
SuaYoo opened this issue Apr 30, 2025 · 1 comment · May be fixed by #2572
Open

Stop paused crawl after time limit #2576

SuaYoo opened this issue Apr 30, 2025 · 1 comment · May be fixed by #2572
Assignees
@ikreymer @tw4l
Labels
back end Requires back end dev work

Comments

@SuaYoo
Copy link
Member

SuaYoo commented Apr 30, 2025

Requirements

  • Add configuration in Helm chart for maximum number of days/hours a crawl can be paused
  • Stop paused crawl after max is reached
  • API: Return timestamp of when crawl was paused (lastCrawlPausedTime or similar)
  • API: Return timestamp of when crawl will become stopped (lastCrawlPausedExpiry or similar)
@SuaYoo SuaYoo added the back end Requires back end dev work label Apr 30, 2025
@ikreymer ikreymer moved this from Triage to Todo in Webrecorder Projects Apr 30, 2025
@SuaYoo SuaYoo mentioned this issue Apr 30, 2025
Open
@tw4l tw4l moved this from Todo to Ready in Webrecorder Projects Apr 30, 2025
@tw4l
Copy link
Member

tw4l commented Apr 30, 2025

To follow from #2572 (current WIP branch is based on that WIP branch, may need rebasing after #2572 is merged)

@ikreymer ikreymer moved this from Ready to Todo in Webrecorder Projects Apr 30, 2025
@ikreymer ikreymer linked a pull request May 1, 2025 that will close this issue
Pause / Resume Crawls Initial Implmentation. #2572
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ikreymer ikreymer

@tw4l tw4l

Labels
back end Requires back end dev work
Projects
Webrecorder Projects
Status: Todo
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Pause / Resume Crawls Initial Implmentation. webrecorder/browsertrix
3 participants
@ikreymer @SuaYoo @tw4l