Adding support for the new Apache Spark Kubernetes Operator

[AHulshoff]

Since May this year there is a new Apache Spark K8s Operator. I think it would be a good idea to extend apache-airflow-providers-apache-spark with an Airflow operator that can use this new Kubernetes operator for Apache Spark. Something like the SparkKubernetesOperator for Kubeflow (maybe this can be used as an example).

[potiuk]

Sure. If someone wants to implement it - it's a good idea to contribute it. Feel free to do it or find someone who can do it if you want it.

[AHulshoff]

I will see what I can do with the capabilities and the resources I have.