hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-8858) Visualize generated Spark plan [Spark Branch]
Date Thu, 13 Nov 2014 15:01:33 GMT
Xuefu Zhang created HIVE-8858:
---------------------------------

             Summary: Visualize generated Spark plan [Spark Branch]
                 Key: HIVE-8858
                 URL: https://issues.apache.org/jira/browse/HIVE-8858
             Project: Hive
          Issue Type: Sub-task
          Components: Spark
            Reporter: Xuefu Zhang


The spark plan generated by SparkPlanGenerator contains info which isn't available in Hive's
explain plan, such as RDD caching. Also, the graph is slight different from orignal SparkWork.
Thus, it would be nice to visualize the plan as is done for SparkWork.

Preferrably, the visualization can happen as part of Hive explain extended. If not feasible,
we at least can log this at info level.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message