Merge pull request #37 from flavienbwk/develop

#33 : Prefect 2.4.2 configuration

Author: flavienbwk

README.md

@@ -1,6 +1,8 @@
 # Prefect - Docker Compose
 
-A simple guide to understand and make Prefect 2.x work with your own docker-compose configuration.
+A simple guide to understand and make Prefect **2.x** work with your own docker-compose configuration.
+
+Interested about version **1.x** configuration ? Switch to the [last 1.x configuration branch](https://github.com/flavienbwk/prefect-docker-compose/tree/e758a498d5819550a9b926b0bf9bb4e9c85574d1).
 
 This allows you to package your Prefect instance for fully-containerized environments (e.g: docker-compose, Kubernetes) or offline use.
 
@@ -18,8 +20,6 @@ This allows you to package your Prefect instance for fully-containerized environ
       - [Start the Docker in Docker agent](#start-the-docker-in-docker-agent)
       - [Registering the flow](#registering-the-flow)
 
-Interested about version **1.x** configuration ? Switch to the [last 1.x configuration branch](https://github.com/flavienbwk/prefect-docker-compose/tree/e758a498d5819550a9b926b0bf9bb4e9c85574d1).
-
 ## Run the server
 
 1. Optionally open and edit the [`server/.env`](./server/.env) file
@@ -92,8 +92,6 @@ This means the Prefect server never stores your code. It just orchestrates the r
 
 ### Flow with S3 Storage (recommended)
 
-:warning: I don't recommend this method if you plan to schedule a lot of flows every minute. MinIO times out regurarly in that case (maybe AWS wouldn't).
-
 <details>
 <summary>Tutorial for S3 Storage</summary>
 <br/>
@@ -175,13 +173,13 @@ We're going to push our Docker image with Python dependencies and register our f
 1. Build, tag and push the image
 
     ```bash
-    docker build . -f ./client_docker/execution.Dockerfile -t 172.17.0.1:5000/weather/base_image
+    docker build . -f ./client_docker/execution.Dockerfile -t 172.17.0.1:5000/weather/base_image:latest
     ```
 
-    > You **must** prefix your image by the registry URI `172.17.0.1`
+    > You **must** prefix your image with the registry URI `172.17.0.1:5000` to push it
 
     ```bash
-    docker push 172.17.0.1:5000/weather/base_image
+    docker push 172.17.0.1:5000/weather/base_image:latest
     ```
 
 2. Register the flow

agent/Dockerfile

@@ -1,4 +1,4 @@
 FROM python:3.10
 
 RUN apt update && apt install uuid -y
-RUN pip install prefect==2.3.2 psycopg2-binary==2.9.3 s3fs==2022.8.2 minio==7.1.11
+RUN pip install prefect==2.4.2 psycopg2-binary==2.9.3 s3fs==2022.8.2 minio==7.1.11

agent_docker/Dockerfile

@@ -4,4 +4,4 @@ ENV TZ="Europe/Paris"
 USER root
 RUN apk update && apk add build-base libffi-dev python3 python3-dev py3-pip gcc linux-headers musl-dev util-linux
 
-RUN pip3 install --upgrade pip && pip3 install prefect==2.3.2
+RUN pip3 install --upgrade pip && pip3 install prefect==2.4.2

client/Dockerfile

@@ -1,6 +1,6 @@
 FROM python:3.10
 
 RUN apt update && apt install uuid -y
-RUN pip install prefect==2.3.2
+RUN pip install prefect==2.4.2
 
 WORKDIR /usr/app

client_docker/Dockerfile

@@ -4,7 +4,7 @@ ENV TZ="Europe/Paris"
 USER root
 RUN apk update && apk add build-base libffi-dev python3 python3-dev py3-pip gcc linux-headers musl-dev util-linux
 
-RUN pip3 install --upgrade pip && pip3 install prefect==2.3.2 docker==6.0.0
+RUN pip3 install --upgrade pip && pip3 install prefect==2.4.2 docker==6.0.0
 
 COPY ./entrypoint.sh /entrypoint.sh
 ENTRYPOINT [ "sh", "/entrypoint.sh" ]

client_docker/execution.Dockerfile

@@ -1,4 +1,4 @@
 FROM python:3.10
 
 RUN apt update && apt install uuid -y
-RUN pip install prefect==2.3.2
+RUN pip3 install --upgrade pip && pip3 install prefect==2.4.2

client_s3/Dockerfile

@@ -1,6 +1,6 @@
 FROM python:3.10
 
 RUN apt update && apt install uuid -y
-RUN pip install prefect==2.3.2 psycopg2-binary==2.9.3 s3fs==2022.8.2 minio==7.1.11
+RUN pip install prefect==2.4.2 psycopg2-binary==2.9.3 s3fs==2022.8.2 minio==7.1.11
 
 WORKDIR /usr/app

server/Dockerfile

@@ -1,4 +1,4 @@
-FROM prefecthq/prefect:2.3.2-python3.10
+FROM prefecthq/prefect:2.4.2-python3.10
 
 RUN apt update && \
     pip install psycopg2-binary==2.9.3 s3fs==2022.8.2