Skip to content

zooniverse/downscaler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

downscaler

A Kubernetes job and Ruby script to scale down Panoptes deployments. Scaling up is managed by KEDA, which automatically increase the number of available pods based on the size of Sidekiq Redis queues. This works great for processing jobs that run in less than the standard timeout, around 25 seconds. But scaling down in the same way is dangerous for much longer-running jobs like data exports, as the k8s downscaling operation doesn't differentiate between active and idle Sidekiq processes. So this utility runs as a cron job in Kubernetes and checks for idle Sidekiq dumpworker processes, periodically killing pods and scaling the deployment down.

About

A Kubernetes job and Ruby script to scale down

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published