hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rui Li (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-17193) HoS: don't combine map works that are targets of different DPPs
Date Tue, 14 Nov 2017 11:26:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-17193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rui Li updated HIVE-17193:
--------------------------
    Attachment: HIVE-17193.2.patch

Update to fix tests.
With the patch, two map works are considered targets of same DPP if:
# They share the same DPP sink operators.
# The DPP sink operators target the same columns of the map works.

Currently we don't combine sub trees within a base work, so this results in some suboptimal
plans, and thus the update of the golden files. I think this is acceptable because correctness
is more important. And it will be improved once we implement HIVE-17178.

> HoS: don't combine map works that are targets of different DPPs
> ---------------------------------------------------------------
>
>                 Key: HIVE-17193
>                 URL: https://issues.apache.org/jira/browse/HIVE-17193
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>            Reporter: Rui Li
>            Assignee: Rui Li
>         Attachments: HIVE-17193.1.patch, HIVE-17193.2.patch
>
>
> Suppose {{srcpart}} is partitioned by {{ds}}. The following query can trigger the issue:
> {code}
> explain
> select * from
>   (select srcpart.ds,srcpart.key from srcpart join src on srcpart.ds=src.key) a
> join
>   (select srcpart.ds,srcpart.key from srcpart join src on srcpart.ds=src.value) b
> on a.key=b.key;
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message