Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement persistent job queue and scheduling service #78

Open
ecton opened this issue Oct 15, 2021 · 0 comments · May be fixed by #211
Open

Implement persistent job queue and scheduling service #78

ecton opened this issue Oct 15, 2021 · 0 comments · May be fixed by #211
Assignees
Labels
enhancement New feature or request
Milestone

Comments

@ecton
Copy link
Member

ecton commented Oct 15, 2021

We need a job service that allows:

  • Independent job queues that can receive jobs.
    • Each queue should have configuration on job handling:
      • Time to allow before allowing another worker to take the job
      • Number of timeouts before considering the job a failure
      • How many completed jobs to retain
  • APIs for:
    • enqueuing a job
    • await an executing job's result
    • dequeue a job
    • posting a job's result
    • query queue statuses
    • scheduling a job as a one-time or recurring job (cron)
  • A mechanism to allow executable jobs to be registered from:
    • Backend
    • Collection
    • Schema
  • Job queues should stop handing out jobs when the server is being shut down, and should block shutdown until jobs have finished.
  • Closing and reopening a database should continue executing any pending jobs.
@ecton ecton added the enhancement New feature or request label Oct 15, 2021
@ecton ecton moved this to Todo in Beta Roadmap Oct 27, 2021
@ecton ecton modified the milestones: v0.1.0, 0.1.0-alpha.2 Nov 3, 2021
@ecton ecton modified the milestones: v0.1.0-alpha.2, v1.0 Jan 18, 2022
@ecton ecton changed the title Implement persistent job service Implement persistent job queue and scheduling service Feb 8, 2022
@ecton ecton modified the milestones: v1.0, vNext Feb 18, 2022
@ecton ecton self-assigned this Feb 18, 2022
@ecton ecton linked a pull request Feb 22, 2022 that will close this issue
@ecton ecton modified the milestones: v0.3.0, v1.0 Mar 3, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Todo
Development

Successfully merging a pull request may close this issue.

1 participant