How to set SparkKubernetesOperator watch=False, apache-airflow-providers-cncf-kubernetes>=7.14.0 #39573
Unanswered
s-natsubori
asked this question in
Q&A
How to set SparkKubernetesOperator watch=False, apache-airflow-providers-cncf-kubernetes>=7.14.0
#39573
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
because my SparkApplication runs long time(over 10min~30min), status check is too heavy.
so I set
watch=False(apache-airflow-providers-cncf-kubernetes==7.13.0)apache-airflow-providers-cncf-kubernetes>=
7.14.0watch=False was replaced other parameters.
which parameter set is compatible with
watch=False?I tried
get_logs=False,delete_on_termination=False.but operator still wait SparkApplication status==COMPLETE.
Beta Was this translation helpful? Give feedback.
All reactions