Skip to content

Latest commit

 

History

History
34 lines (23 loc) · 872 Bytes

README.md

File metadata and controls

34 lines (23 loc) · 872 Bytes

Windmill VS Airflow, Prefect, Temporal and Kestra

Benchmarks

2 kind of workflows:

  • 10 sequential long running tasks
  • 40 sequential lightweight tasks

We took the Fibonacci numbers as a good template for both use case:

def fibo(n: int):
    if n <= 1:
        return n
    else:
        return fibo(n - 1) + fibo(n - 2)

For the lightweight tasks we computed fibo(10) and for the long running tasks, we choose fibo(33).

We executed the benchmarks on an EC2 t2-medium instance, always using Docker compose to spin up the orchestrator.

Retrieving the results and assembling them is a very manual tasks and differs by orchestrator.

Howtos

Airflow

Prefect

Temporal

Kestra

Windmill