hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aihua Xu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-11799) The output of explain query for multiple lateral views is huge
Date Fri, 11 Sep 2015 19:07:46 GMT

     [ https://issues.apache.org/jira/browse/HIVE-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Aihua Xu updated HIVE-11799:
----------------------------
    Attachment: HIVE-11799.patch

Seems it's not necessary to recursively print out the nodes if the nodes have printed. 

> The output of explain query for multiple lateral views is huge
> --------------------------------------------------------------
>
>                 Key: HIVE-11799
>                 URL: https://issues.apache.org/jira/browse/HIVE-11799
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Hive
>    Affects Versions: 2.0.0
>            Reporter: Aihua Xu
>            Assignee: Aihua Xu
>             Fix For: 2.0.0
>
>         Attachments: HIVE-11799.patch
>
>
> Execute the following query
> {noformat}
> CREATE TABLE `t1`(`pattern` array<int>);
>   
> explain select * from t1 
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1
> lateral view explode(pattern) tbl1 as col1;
> {noformat}
> After HIVE-11617 gets fixed, the explain output still takes forever since we are recursively
printing operator info which could be an issue if the ops could have multiple children and
parents, like lateral view case. Right now, if a node has multiple parents, then it including
its descendants will be printed multiple times. We should print once and probably print just
a reference later on. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message