airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Azhagu Selvan SP (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-2096) SparkSubmitOperator should expose yarn_application_id in the templates
Date Fri, 09 Feb 2018 22:07:00 GMT
Azhagu Selvan SP created AIRFLOW-2096:
-----------------------------------------

             Summary: SparkSubmitOperator should expose yarn_application_id in the templates
                 Key: AIRFLOW-2096
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2096
             Project: Apache Airflow
          Issue Type: Improvement
            Reporter: Azhagu Selvan SP


The SparkSubmitHook parses and stores the `application_id` from YARN in the field `yarn_application_id`.
It would be very useful if this value is exposed as a template field in the SparkSubmitOperator
so that we can build a direct link to the YARN Application master from the Airflow UI. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message