hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chinna Rao Lalam (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-8858) Visualize generated Spark plan [Spark Branch]
Date Thu, 09 Apr 2015 12:47:12 GMT

     [ https://issues.apache.org/jira/browse/HIVE-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chinna Rao Lalam updated HIVE-8858:
-----------------------------------
    Attachment: HIVE-8858.2-spark.patch

> Visualize generated Spark plan [Spark Branch]
> ---------------------------------------------
>
>                 Key: HIVE-8858
>                 URL: https://issues.apache.org/jira/browse/HIVE-8858
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Xuefu Zhang
>            Assignee: Chinna Rao Lalam
>         Attachments: HIVE-8858-spark.patch, HIVE-8858.1-spark.patch, HIVE-8858.2-spark.patch
>
>
> The spark plan generated by SparkPlanGenerator contains info which isn't available in
Hive's explain plan, such as RDD caching. Also, the graph is slight different from orignal
SparkWork. Thus, it would be nice to visualize the plan as is done for SparkWork.
> Preferrably, the visualization can happen as part of Hive explain extended. If not feasible,
we at least can log this at info level.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message