hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sahil Takiar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11133) Support hive.explain.user for Spark [Spark Branch]
Date Wed, 19 Apr 2017 14:54:41 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974826#comment-15974826
] 

Sahil Takiar commented on HIVE-11133:
-------------------------------------

[~xuefuz] could you take a look? This patch basically adds support for User-Level Explain
plans to HoS. Previously, it only worked for Tez. User-Level Explain plans were added in HIVE-9780
and the documentation can be found [here|https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Explain#LanguageManualExplain-User-levelExplainOutput].
My comment [here|#comment-15966675] has an explanation of the changes. And I have made a few
more changes since then:

* Added a new config called {{hive.spark.explain.user}} that is an equivalent of {{hive.explain.user}}
but is Spark specific. {{hive.explain.user}} is true by default, {{hive.spark.explain.user}}
is false by default
* I copied {{explainuser_1.q}} to {{spark_explainuser_1.q}} and generated a {{spark_explainuser_1.q.out}}
file - I confirmed that the new explain plans look correct

> Support hive.explain.user for Spark [Spark Branch]
> --------------------------------------------------
>
>                 Key: HIVE-11133
>                 URL: https://issues.apache.org/jira/browse/HIVE-11133
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Mohit Sabharwal
>            Assignee: Sahil Takiar
>         Attachments: HIVE-11133.1.patch, HIVE-11133.2.patch, HIVE-11133.3.patch, HIVE-11133.4.patch,
HIVE-11133.5.patch, HIVE-11133.6.patch, HIVE-11133.7.patch
>
>
> User friendly explain output ({{set hive.explain.user=true}}) should support Spark as
well. 
> Once supported, we should also enable related q-tests like {{explainuser_1.q}}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message