Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Roadmap: Asynchronous Crawling #1

Open
fvaldes33 opened this issue Oct 17, 2019 · 0 comments
Open

Roadmap: Asynchronous Crawling #1

fvaldes33 opened this issue Oct 17, 2019 · 0 comments
Labels
enhancement New feature or request
Milestone
1.0.0

Comments

@fvaldes33
Copy link

Current Status:
Currently, the tool only crawls the initial page, then the user can manually select which other pages to crawl.

Future Status:
Tool would be able to kick off a background job that would crawl any number of pages provided by the project settings forms. In the case that "Crawl All Pages" is selected then the job will continue until there are no un-crawled pages.

This "job" should be able to be paused, resumed and cancelled at any time. There should be some sort of progress indicator and UI for the management of this feature.
@fvaldes33 fvaldes33 added the enhancement New feature or request label Oct 17, 2019
@fvaldes33 fvaldes33 added this to the 1.0.0 milestone Oct 17, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
1.0.0
Development

No branches or pull requests
1 participant
@fvaldes33