hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sahil Takiar (JIRA)" <>
Subject [jira] [Created] (HIVE-18525) Add explain plan to Hive on Spark Web UI
Date Wed, 24 Jan 2018 18:39:00 GMT
Sahil Takiar created HIVE-18525:

             Summary: Add explain plan to Hive on Spark Web UI
                 Key: HIVE-18525
             Project: Hive
          Issue Type: Sub-task
          Components: Spark
            Reporter: Sahil Takiar

More of an investigation JIRA. The Spark UI has a "long description" of each stage in the
Spark DAG. Typically one stage in the Spark DAG corresponds to either a {{MapWork}} or {{ReduceWork}}
object. It would be useful if the long description contained the explain plan of the corresponding
work object.

I'm not sure how much additional overhead this would introduce. If not the full explain plan,
then maybe a modified one that just lists out all the operator tree along with each operator

This message was sent by Atlassian JIRA

View raw message