Skip to content

Commit

Permalink
Update supported versions. (#274)
Browse files Browse the repository at this point in the history
* Update supported versions.

* Fix image name and add scala version.
  • Loading branch information
razvan authored Aug 18, 2023
1 parent 2c807ca commit 9055812
Show file tree
Hide file tree
Showing 2 changed files with 7 additions and 4 deletions.
5 changes: 5 additions & 0 deletions docs/modules/spark-k8s/pages/index.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -57,3 +57,8 @@ In the xref:stackablectl::demos/spark-k8s-anomaly-detection-taxi-data.adoc[] dem
The Stackable Operator for Apache Spark on Kubernetes currently supports the following versions of Spark:

include::partial$supported-versions.adoc[]

The Spark images do not include Python. For PySpark users, there are separate images called `pyspark-k8s` instead of `spark-k8s`. These come with different Python versions as follows:

- pyspark-k8s:3.3.0-hadoop3 : Python 3.9
- pyspark-k8s:3.4.0-hadoop3 : Python 3.11
6 changes: 2 additions & 4 deletions docs/modules/spark-k8s/partials/supported-versions.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,5 @@
// This is a separate file, since it is used by both the direct Spark documentation, and the overarching
// Stackable Platform documentation.

- 3.2.1-hadoop3.2
- 3.2.1-hadoop3.2-python39
- 3.3.0-hadoop3
- 3.4.0-hadoop3
- 3.3.0-hadoop3 (Hadoop 3.3.3, Scala 2.12, Java 11)
- 3.4.0-hadoop3 (Hadoop 3.3.4, Scala 2.12, Java 11)

0 comments on commit 9055812

Please sign in to comment.