Skip to content

Commit

Permalink
flyte concepts
Browse files Browse the repository at this point in the history
  • Loading branch information
BerndDoser committed Oct 14, 2024
1 parent 206c564 commit 141994f
Showing 1 changed file with 19 additions and 10 deletions.
29 changes: 19 additions & 10 deletions flyte.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -5,16 +5,6 @@
- Member of the [Linux Foundation AI & Data](https://lfaidata.foundation/projects/flyte/)


## Flyte Nomenclature

- **Project**: A collection of workflows, tasks, and executions
- **Domain**: Deployment level (`development`, `staging`, and `production`)
- **Workflow**: A collection (directed acyclic graph) of tasks
- **Task**: Fully independent unit of work
- **Execution**: A run of a task or workflow
- **Launch Plan**: A scheduled execution of a workflow


## Flyte Test Setup

![](images/flyte-test-setup.svg){fig-align="center"}
Expand All @@ -25,13 +15,30 @@ Thanks to Martin Wendt (ITS) for providing a comprehensive testing setup includi
## Flyte Command-line Interface

- Start a demo cluster on your local machine

```{.bash code-line-numbers="false"}
flytectl start demo
```

- Create a new project

```{.bash code-line-numbers="false"}
flytectl create project --name seminar --id seminar --description "seminar showcases"
```

- Manage workflows, tasks, and executions


## Flyte Concepts

- **Project**: A collection of workflows, tasks, and executions
- **Domain**: Deployment level (`development`, `staging`, and `production`)
- **Workflow**: A collection (directed acyclic graph) of tasks
- **Task**: Fully independent unit of work
- **Execution**: A run of a task or workflow
- **Launch Plan**: A scheduled execution of a workflow


## Flyte Tasks

- Tasks are strongly typed (see [Flyte Type Mapping](https://docs.flyte.org/en/latest/user_guide/data_types_and_io/index.html#data-types-and-io))
Expand All @@ -47,6 +54,7 @@ def mean(values: List[float]) -> float:
return sum(values) / len(values)
```


## Flyte Workflows

Workflows are used to structure the task execution graph
Expand Down Expand Up @@ -92,6 +100,7 @@ def nlp_workflow(target_word: str = "computer") -> [Dict[str, float], float, Dic
[Source](https://docs.flyte.org/en/latest/flytesnacks/examples/nlp_processing/word2vec_and_lda.html)
:::


## Containerized Tasks

A Flyte task operates within its own container and runs on a Kubernetes pod
Expand Down

0 comments on commit 141994f

Please sign in to comment.