[FLINK-37776][python] Drop python 3.8 support

autophagy · autophagy · commit 555f0beef3ca · 2025-05-22T12:54:25.000+01:00
diff --git a/docs/content.zh/docs/deployment/cli.md b/docs/content.zh/docs/deployment/cli.md
@@ -428,11 +428,11 @@ Currently, users are able to submit a PyFlink job via the CLI. It does not requi
 JAR file path or the entry main class, which is different from the Java job submission.
 
 {{< hint info >}}
-When submitting Python job via `flink run`, Flink will run the command "python". Please run the following command to confirm that the python executable in current environment points to a supported Python version of 3.8+.
+When submitting Python job via `flink run`, Flink will run the command "python". Please run the following command to confirm that the python executable in current environment points to a supported Python version of 3.9+.
 {{< /hint >}}
 ```bash
 $ python --version
-# the version printed here must be 3.8+
+# the version printed here must be 3.9+
 ```
 
 The following commands show different PyFlink job submission use-cases:
@@ -576,7 +576,7 @@ related options. Here's an overview of all the Python related options for the ac
             <td>
                 Specify the path of the python interpreter used to execute the python UDF worker
                 (e.g.: --pyExecutable /usr/local/bin/python3).
-                The python UDF worker depends on Python 3.8+, Apache Beam (version >= 2.54.0, <= 2.61.0),
+                The python UDF worker depends on Python 3.9+, Apache Beam (version >= 2.54.0, <= 2.61.0),
                 Pip (version >= 20.3) and SetupTools (version >= 37.0.0).
                 Please ensure that the specified environment meets the above requirements.
             </td>
diff --git a/docs/content.zh/docs/dev/python/datastream_tutorial.md b/docs/content.zh/docs/dev/python/datastream_tutorial.md
@@ -48,7 +48,7 @@ Apache Flink 提供了 DataStream API，用于构建健壮的、有状态的流
 首先，你需要在你的电脑上准备以下环境：
 
 * Java 11
-* Python 3.8, 3.9 or 3.10
+* Python 3.9, 3.10, 3.11 or 3.12
 
 使用 Python DataStream API 需要安装 PyFlink，PyFlink 发布在 [PyPI](https://pypi.org/project/apache-flink/)上，可以通过 `pip` 快速安装。 
 
diff --git a/docs/content.zh/docs/dev/python/installation.md b/docs/content.zh/docs/dev/python/installation.md
@@ -29,11 +29,11 @@ under the License.
 
 
 ## 环境要求
-<span class="label label-info">注意</span> PyFlink 需要 Python 3.7 以上版本（3.8, 3.9 或 3.10）。请运行以下命令，以确保 Python 版本满足要求。
+<span class="label label-info">注意</span> PyFlink 需要 Python 3.9 以上版本（3.9, 3.10, 3.11 或 3.12）。请运行以下命令，以确保 Python 版本满足要求。
 
 ```bash
 $ python --version
-# the version printed here must be 3.8, 3.9 or 3.10
+# the version printed here must be 3.9, 3.10, 3.11 or 3.12
 ```
 
 ## 环境设置
diff --git a/docs/content.zh/docs/dev/python/python_execution_mode.md b/docs/content.zh/docs/dev/python/python_execution_mode.md
@@ -121,9 +121,6 @@ Currently, it still doesn't support to execute Python UDFs in `THREAD` execution
 It will fall back to `PROCESS` execution mode in these cases. So it may happen that you configure a job
 to execute in `THREAD` execution mode, however, it's actually executed in `PROCESS` execution mode.
 {{< /hint >}}
-{{< hint info >}}
-`THREAD` execution mode is only supported in Python 3.8+.
-{{< /hint >}}
 
 ## Execution Behavior
 
diff --git a/docs/content.zh/docs/dev/python/table/udfs/python_udfs.md b/docs/content.zh/docs/dev/python/table/udfs/python_udfs.md
@@ -28,7 +28,7 @@ under the License.
 
 用户自定义函数是重要的功能，因为它们极大地扩展了 Python Table API 程序的表达能力。
 
-**注意:** 要执行 Python 用户自定义函数，客户端和集群端都需要安装 Python 3.7 以上版本(3.7、3.8、3.9 或 3.10)，并安装 PyFlink。
+**注意:** 要执行 Python 用户自定义函数，客户端和集群端都需要安装 Python 3.9 以上版本(3.9、3.10、3.11 或 3.12)，并安装 PyFlink。
 
 <a name="scalar-functions"></a>
 
diff --git a/docs/content.zh/docs/dev/python/table/udfs/vectorized_python_udfs.md b/docs/content.zh/docs/dev/python/table/udfs/vectorized_python_udfs.md
@@ -34,7 +34,7 @@ under the License.
 向量化用户自定义函数的定义，与[非向量化用户自定义函数]({{< ref "docs/dev/python/table/udfs/python_udfs" >}})具有相似的方式，
 用户只需要在调用 `udf` 或者 `udaf` 装饰器时添加一个额外的参数 `func_type="pandas"`，将其标记为一个向量化用户自定义函数即可。
 
-**注意:** 要执行 Python 向量化自定义函数，客户端和集群端都需要安装 Python 3.7 以上版本(3.7、3.8、3.9 或 3.10)，并安装 PyFlink。
+**注意:** 要执行 Python 向量化自定义函数，客户端和集群端都需要安装 Python 3.9 以上版本(3.9、3.10、3.11 或 3.12)，并安装 PyFlink。
 
 ## 向量化标量函数
 
diff --git a/docs/content.zh/docs/dev/python/table_api_tutorial.md b/docs/content.zh/docs/dev/python/table_api_tutorial.md
@@ -50,7 +50,7 @@ Apache Flink 提供 Table API 关系型 API 来统一处理流和批，即查询
 如果要继续我们的旅程，你需要一台具有以下功能的计算机：
 
 * Java 11
-* Python 3.8, 3.9 or 3.10
+* Python 3.9, 3.10, 3.11 or 3.12
 
 使用 Python Table API 需要安装 PyFlink，它已经被发布到 [PyPi](https://pypi.org/project/apache-flink/)，你可以通过如下方式安装 PyFlink：
 
diff --git a/docs/content.zh/docs/dev/table/sqlClient.md b/docs/content.zh/docs/dev/table/sqlClient.md
@@ -321,7 +321,7 @@ Mode "embedded" (default) submits Flink jobs from the local machine.
                                                 --pyExecutable
                                                 /usr/local/bin/python3). The
                                                 python UDF worker depends on
-                                                Python 3.8+, Apache Beam
+                                                Python 3.9+, Apache Beam
                                                 (version >= 2.54.0, <= 2.61.0), Pip
                                                 (version >= 20.3) and SetupTools
                                                 (version >= 37.0.0). Please
diff --git a/docs/content.zh/docs/flinkDev/building.md b/docs/content.zh/docs/flinkDev/building.md
@@ -73,11 +73,11 @@ mvn clean install -DskipTests -Dfast -Pskip-webui-build -T 1C
 
     如果想构建一个可用于 pip 安装的 PyFlink 包，需要先构建 Flink 工程，如 [构建 Flink](#build-flink) 中所述。
 
-2. Python 的版本为 3.8, 3.9 或者 3.10.
+2. Python 的版本为 3.9, 3.10, 3.11 或者 3.12.
 
     ```shell
     $ python --version
-    # the version printed here must be 3.8, 3.9 or 3.10
+    # the version printed here must be 3.9, 3.10, 3.11 or 3.12
     ```
 
 3. 构建 PyFlink 的 Cython 扩展模块（可选的）
diff --git a/docs/content/docs/deployment/cli.md b/docs/content/docs/deployment/cli.md
@@ -426,11 +426,11 @@ Currently, users are able to submit a PyFlink job via the CLI. It does not requi
 JAR file path or the entry main class, which is different from the Java job submission.
 
 {{< hint info >}}
-When submitting Python job via `flink run`, Flink will run the command "python". Please run the following command to confirm that the python executable in current environment points to a supported Python version of 3.8+.
+When submitting Python job via `flink run`, Flink will run the command "python". Please run the following command to confirm that the python executable in current environment points to a supported Python version of 3.9+.
 {{< /hint >}}
 ```bash
 $ python --version
-# the version printed here must be 3.8+
+# the version printed here must be 3.9+
 ```
 
 The following commands show different PyFlink job submission use-cases:
@@ -574,7 +574,7 @@ related options. Here's an overview of all the Python related options for the ac
             <td>
                 Specify the path of the python interpreter used to execute the python UDF worker
                 (e.g.: --pyExecutable /usr/local/bin/python3).
-                The python UDF worker depends on Python 3.8+, Apache Beam (version >= 2.54.0,<= 2.61.0),
+                The python UDF worker depends on Python 3.9+, Apache Beam (version >= 2.54.0,<= 2.61.0),
                 Pip (version >= 20.3) and SetupTools (version >= 37.0.0).
                 Please ensure that the specified environment meets the above requirements.
             </td>
diff --git a/docs/content/docs/dev/python/datastream_tutorial.md b/docs/content/docs/dev/python/datastream_tutorial.md
@@ -47,7 +47,7 @@ In particular, Apache Flink's [user mailing list](https://flink.apache.org/commu
 If you want to follow along, you will require a computer with: 
 
 * Java 11
-* Python 3.8, 3.9, 3.10, 3.11 or 3.12
+* Python 3.9, 3.10, 3.11 or 3.12
 
 Using Python DataStream API requires installing PyFlink, which is available on [PyPI](https://pypi.org/project/apache-flink/) and can be easily installed using `pip`. 
 
diff --git a/docs/content/docs/dev/python/installation.md b/docs/content/docs/dev/python/installation.md
@@ -29,12 +29,12 @@ under the License.
 ## Environment Requirements
 
 {{< hint info >}}
-Python version (3.8, 3.9, 3.10, 3.11 or 3.12) is required for PyFlink. Please run the following command to make sure that it meets the requirements:
+Python version (3.9, 3.10, 3.11 or 3.12) is required for PyFlink. Please run the following command to make sure that it meets the requirements:
 {{< /hint >}}
 
 ```bash
 $ python --version
-# the version printed here must be 3.8, 3.9, 3.10, 3.11 or 3.12
+# the version printed here must be 3.9, 3.10, 3.11 or 3.12
 ```
 
 ## Environment Setup
diff --git a/docs/content/docs/dev/python/python_execution_mode.md b/docs/content/docs/dev/python/python_execution_mode.md
@@ -121,9 +121,6 @@ Currently, it still doesn't support to execute Python UDFs in `THREAD` execution
 It will fall back to `PROCESS` execution mode in these cases. So it may happen that you configure a job
 to execute in `THREAD` execution mode, however, it's actually executed in `PROCESS` execution mode.
 {{< /hint >}}
-{{< hint info >}}
-`THREAD` execution mode is only supported in Python 3.8+.
-{{< /hint >}}
 
 ## Execution Behavior
 
diff --git a/docs/content/docs/dev/python/table/udfs/python_udfs.md b/docs/content/docs/dev/python/table/udfs/python_udfs.md
@@ -28,7 +28,7 @@ under the License.
 
 User-defined functions are important features, because they significantly extend the expressiveness of Python Table API programs.
 
-**NOTE:** Python UDF execution requires Python version (3.8, 3.9 or 3.10) with PyFlink installed. It's required on both the client side and the cluster side. 
+**NOTE:** Python UDF execution requires Python version (3.9, 3.10, 3.11 or 3.12) with PyFlink installed. It's required on both the client side and the cluster side.
 
 ## Scalar Functions
 
diff --git a/docs/content/docs/dev/python/table/udfs/vectorized_python_udfs.md b/docs/content/docs/dev/python/table/udfs/vectorized_python_udfs.md
@@ -33,7 +33,7 @@ These Python libraries are highly optimized and provide high-performance data st
 [non-vectorized user-defined functions]({{< ref "docs/dev/python/table/udfs/python_udfs" >}}) on how to define vectorized user-defined functions.
 Users only need to add an extra parameter `func_type="pandas"` in the decorator `udf` or `udaf` to mark it as a vectorized user-defined function.
 
-**NOTE:** Python UDF execution requires Python version (3.8, 3.9 or 3.10) with PyFlink installed. It's required on both the client side and the cluster side. 
+**NOTE:** Python UDF execution requires Python version (3.9, 3.10, 3.11 or 3.12) with PyFlink installed. It's required on both the client side and the cluster side.
 
 ## Vectorized Scalar Functions
 
diff --git a/docs/content/docs/dev/python/table_api_tutorial.md b/docs/content/docs/dev/python/table_api_tutorial.md
@@ -51,7 +51,7 @@ In particular, Apache Flink's [user mailing list](https://flink.apache.org/commu
 If you want to follow along, you will require a computer with: 
 
 * Java 11
-* Python 3.8, 3.9, 3.10, 3.11 or 3.12
+* Python 3.9, 3.10, 3.11 or 3.12
 
 Using Python Table API requires installing PyFlink, which is available on [PyPI](https://pypi.org/project/apache-flink/) and can be easily installed using `pip`. 
 
diff --git a/docs/content/docs/dev/table/sqlClient.md b/docs/content/docs/dev/table/sqlClient.md
@@ -259,7 +259,7 @@ Mode "embedded" (default) submits Flink jobs from the local machine.
                                                 --pyExecutable
                                                 /usr/local/bin/python3). The
                                                 python UDF worker depends on
-                                                Python 3.8+, Apache Beam
+                                                Python 3.9+, Apache Beam
                                                 (version >= 2.54.0, <= 2.61.0), Pip
                                                 (version >= 20.3) and SetupTools
                                                 (version >= 37.0.0). Please
diff --git a/docs/content/docs/flinkDev/building.md b/docs/content/docs/flinkDev/building.md
@@ -72,11 +72,11 @@ The `fast` and `skip-webui-build` profiles have a significant impact on the buil
 
     If you want to build a PyFlink package that can be used for pip installation, you need to build the Flink project first, as described in [Build Flink](#build-flink).
 
-2. Python version(3.8, 3.9, 3.10, 3.11 or 3.12) is required
+2. Python version(3.9, 3.10, 3.11 or 3.12) is required
 
     ```shell
     $ python --version
-    # the version printed here must be 3.8, 3.9, 3.10, 3.11 or 3.12
+    # the version printed here must be 3.9, 3.10, 3.11 or 3.12
     ```
 
 3. Build PyFlink with Cython extension support (optional)
diff --git a/docs/layouts/shortcodes/generated/python_configuration.html b/docs/layouts/shortcodes/generated/python_configuration.html
@@ -24,7 +24,7 @@
             <td><h5>python.executable</h5></td>
             <td style="word-wrap: break-word;">"python"</td>
             <td>String</td>
-            <td>Specify the path of the python interpreter used to execute the python UDF worker. The python UDF worker depends on Python 3.8+, Apache Beam (version &gt;= 2.54.0, &lt;= 2.61.0), Pip (version &gt;= 20.3) and SetupTools (version &gt;= 37.0.0). Please ensure that the specified environment meets the above requirements. The option is equivalent to the command line option "-pyexec".</td>
+            <td>Specify the path of the python interpreter used to execute the python UDF worker. The python UDF worker depends on Python 3.9+, Apache Beam (version &gt;= 2.54.0, &lt;= 2.61.0), Pip (version &gt;= 20.3) and SetupTools (version &gt;= 37.0.0). Please ensure that the specified environment meets the above requirements. The option is equivalent to the command line option "-pyexec".</td>
         </tr>
         <tr>
             <td><h5>python.execution-mode</h5></td>
diff --git a/flink-clients/src/main/java/org/apache/flink/client/cli/CliFrontendParser.java b/flink-clients/src/main/java/org/apache/flink/client/cli/CliFrontendParser.java
@@ -275,7 +275,7 @@ public class CliFrontendParser {
                     true,
                     "Specify the path of the python interpreter used to execute the python UDF worker "
                             + "(e.g.: --pyExecutable /usr/local/bin/python3). "
-                            + "The python UDF worker depends on Python 3.8+, Apache Beam (version >= 2.54.0, <= 2.61.0), "
+                            + "The python UDF worker depends on Python 3.9+, Apache Beam (version >= 2.54.0, <= 2.61.0), "
                             + "Pip (version >= 20.3) and SetupTools (version >= 37.0.0). "
                             + "Please ensure that the specified environment meets the above requirements.");
 
diff --git a/flink-python/README.md b/flink-python/README.md
@@ -60,13 +60,13 @@ export FLINK_UV_HOME=$(dirname $(dirname $(which uv)))
 
 Create a virtual environment:
 ```shell
-uv venv pyflink_38 --python=3.8
+uv venv pyflink_39 --python=3.9
 ```
 
 Then you can activate your environment and run tests, for example:
 
 ```shell
-source pyflink_38/bin/activate
+source pyflink_39/bin/activate
 uv pip install -r ./dev/dev-requirements.txt
 ./dev/lint-python.sh
 ```
diff --git a/flink-python/apache-flink-libraries/setup.py b/flink-python/apache-flink-libraries/setup.py
@@ -225,14 +225,13 @@ def find_file_path(pattern):
         license='https://www.apache.org/licenses/LICENSE-2.0',
         author='Apache Software Foundation',
         author_email='dev@flink.apache.org',
-        python_requires='>=3.8',
+        python_requires='>=3.9',
         description='Apache Flink Libraries',
         long_description=long_description,
         long_description_content_type='text/markdown',
         classifiers=[
             'Development Status :: 5 - Production/Stable',
             'License :: OSI Approved :: Apache Software License',
-            'Programming Language :: Python :: 3.8',
             'Programming Language :: Python :: 3.9',
             'Programming Language :: Python :: 3.10',
             'Programming Language :: Python :: 3.11',
diff --git a/flink-python/dev/build-wheels.sh b/flink-python/dev/build-wheels.sh
@@ -19,7 +19,7 @@ set -e -x
 dev/lint-python.sh -s py_env
 
 PY_ENV_DIR=`pwd`/dev/.uv/envs
-py_env=("3.8" "3.9" "3.10" "3.11" "3.12")
+py_env=("3.9" "3.10" "3.11" "3.12")
 ## 2. install dependency
 for ((i=0;i<${#py_env[@]};i++)) do
     source `pwd`/dev/.uv/envs/${py_env[i]}/bin/activate
diff --git a/flink-python/dev/lint-python.sh b/flink-python/dev/lint-python.sh
@@ -217,7 +217,7 @@ function install_uv() {
 
 # Create different Python virtual environments for different Python versions
 function install_py_env() {
-    py_env=("3.8" "3.9" "3.10" "3.11" "3.12")
+    py_env=("3.9" "3.10" "3.11" "3.12")
     for ((i=0;i<${#py_env[@]};i++)) do
         if [ -d "$CURRENT_DIR/.uv/envs/${py_env[i]}" ]; then
             rm -rf "$CURRENT_DIR/.uv/envs/${py_env[i]}"
@@ -378,7 +378,7 @@ function install_environment() {
     fi
 
     # step-2 install python environment which includes
-    # 3.8 3.9 3.10 3.11 3.12
+    # 3.9 3.10 3.11 3.12
     if [ $STEP -lt 2 ] && [ `need_install_component "py_env"` = true ]; then
         print_function "STEP" "installing python environment..."
         install_py_env
diff --git a/flink-python/pyproject.toml b/flink-python/pyproject.toml
@@ -27,7 +27,7 @@ requires = [
 ]
 
 [tool.cibuildwheel]
-build = ["cp38-*", "cp39-*", "cp310-*", "cp311-*", "cp312-*"]
+build = ["cp39-*", "cp310-*", "cp311-*", "cp312-*"]
 
 [tool.cibuildwheel.macos]
 archs = ["x86_64", "arm64"]
diff --git a/flink-python/setup.py b/flink-python/setup.py
@@ -28,8 +28,8 @@
 from setuptools import setup, Extension
 from xml.etree import ElementTree as ET
 
-if sys.version_info < (3, 8):
-    print("Python versions prior to 3.8 are not supported for PyFlink.",
+if sys.version_info < (3, 9):
+    print("Python versions prior to 3.9 are not supported for PyFlink.",
           file=sys.stderr)
     sys.exit(-1)
 
@@ -341,7 +341,7 @@ def extracted_output_files(base_dir, file_path, output_directory):
         license='https://www.apache.org/licenses/LICENSE-2.0',
         author='Apache Software Foundation',
         author_email='dev@flink.apache.org',
-        python_requires='>=3.8',
+        python_requires='>=3.9',
         install_requires=install_requires,
         cmdclass={'build_ext': build_ext},
         description='Apache Flink Python API',
@@ -351,7 +351,6 @@ def extracted_output_files(base_dir, file_path, output_directory):
         classifiers=[
             'Development Status :: 5 - Production/Stable',
             'License :: OSI Approved :: Apache Software License',
-            'Programming Language :: Python :: 3.8',
             'Programming Language :: Python :: 3.9',
             'Programming Language :: Python :: 3.10',
             'Programming Language :: Python :: 3.11',
diff --git a/flink-python/src/main/java/org/apache/flink/python/PythonOptions.java b/flink-python/src/main/java/org/apache/flink/python/PythonOptions.java
@@ -159,7 +159,7 @@ public class PythonOptions {
                     .defaultValue("python")
                     .withDescription(
                             "Specify the path of the python interpreter used to execute the python "
-                                    + "UDF worker. The python UDF worker depends on Python 3.8+, Apache Beam "
+                                    + "UDF worker. The python UDF worker depends on Python 3.9+, Apache Beam "
                                     + "(version >= 2.54.0, <= 2.61.0), Pip (version >= 20.3) and SetupTools (version >= 37.0.0). "
                                     + "Please ensure that the specified environment meets the above requirements. The "
                                     + "option is equivalent to the command line option \"-pyexec\".");
diff --git a/flink-python/tox.ini b/flink-python/tox.ini
@@ -21,7 +21,7 @@
 # in multiple virtualenvs. This configuration file will run the
 # test suite on all supported python versions.
 # new environments will be excluded by default unless explicitly added to envlist.
-envlist = {py38, py39, py310, py311, py312}-cython
+envlist = {py39, py310, py311, py312}-cython
 
 [testenv]
 whitelist_externals=
diff --git a/flink-table/flink-sql-client/src/test/resources/cli/all-mode-help.out b/flink-table/flink-sql-client/src/test/resources/cli/all-mode-help.out
@@ -84,7 +84,7 @@ Mode "embedded" (default) submits Flink jobs from the local machine.
                                                 --pyExecutable
                                                 /usr/local/bin/python3). The
                                                 python UDF worker depends on
-                                                Python 3.8+, Apache Beam
+                                                Python 3.9+, Apache Beam
                                                 (version >= 2.54.0, <= 2.61.0),
                                                 Pip (version >= 20.3) and
                                                 SetupTools (version >= 37.0.0).
diff --git a/flink-table/flink-sql-client/src/test/resources/cli/embedded-mode-help.out b/flink-table/flink-sql-client/src/test/resources/cli/embedded-mode-help.out
@@ -81,7 +81,7 @@ Mode "embedded" (default) submits Flink jobs from the local machine.
                                                 --pyExecutable
                                                 /usr/local/bin/python3). The
                                                 python UDF worker depends on
-                                                Python 3.8+, Apache Beam
+                                                Python 3.9+, Apache Beam
                                                 (version >= 2.54.0, <= 2.61.0),
                                                 Pip (version >= 20.3) and
                                                 SetupTools (version >= 37.0.0).
diff --git a/tools/releasing/create_binary_release.sh b/tools/releasing/create_binary_release.sh
