From 141994f69905372e4c0be3862755c45cc9ca94ff Mon Sep 17 00:00:00 2001 From: Bernd Doser Date: Mon, 14 Oct 2024 16:43:32 +0200 Subject: [PATCH] flyte concepts --- flyte.qmd | 29 +++++++++++++++++++---------- 1 file changed, 19 insertions(+), 10 deletions(-) diff --git a/flyte.qmd b/flyte.qmd index a448504..ade7149 100644 --- a/flyte.qmd +++ b/flyte.qmd @@ -5,16 +5,6 @@ - Member of the [Linux Foundation AI & Data](https://lfaidata.foundation/projects/flyte/) -## Flyte Nomenclature - -- **Project**: A collection of workflows, tasks, and executions -- **Domain**: Deployment level (`development`, `staging`, and `production`) -- **Workflow**: A collection (directed acyclic graph) of tasks -- **Task**: Fully independent unit of work -- **Execution**: A run of a task or workflow -- **Launch Plan**: A scheduled execution of a workflow - - ## Flyte Test Setup ![](images/flyte-test-setup.svg){fig-align="center"} @@ -25,13 +15,30 @@ Thanks to Martin Wendt (ITS) for providing a comprehensive testing setup includi ## Flyte Command-line Interface - Start a demo cluster on your local machine + +```{.bash code-line-numbers="false"} +flytectl start demo +``` + - Create a new project + ```{.bash code-line-numbers="false"} flytectl create project --name seminar --id seminar --description "seminar showcases" ``` + - Manage workflows, tasks, and executions +## Flyte Concepts + +- **Project**: A collection of workflows, tasks, and executions +- **Domain**: Deployment level (`development`, `staging`, and `production`) +- **Workflow**: A collection (directed acyclic graph) of tasks +- **Task**: Fully independent unit of work +- **Execution**: A run of a task or workflow +- **Launch Plan**: A scheduled execution of a workflow + + ## Flyte Tasks - Tasks are strongly typed (see [Flyte Type Mapping](https://docs.flyte.org/en/latest/user_guide/data_types_and_io/index.html#data-types-and-io)) @@ -47,6 +54,7 @@ def mean(values: List[float]) -> float: return sum(values) / len(values) ``` + ## Flyte Workflows Workflows are used to structure the task execution graph @@ -92,6 +100,7 @@ def nlp_workflow(target_word: str = "computer") -> [Dict[str, float], float, Dic [Source](https://docs.flyte.org/en/latest/flytesnacks/examples/nlp_processing/word2vec_and_lda.html) ::: + ## Containerized Tasks A Flyte task operates within its own container and runs on a Kubernetes pod