hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jesus Camacho Rodriguez (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-14413) Extend HivePreFilteringRule to traverse inside elements of DNF/CNF and extract more deterministic pieces out
Date Tue, 09 Aug 2016 14:53:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15413654#comment-15413654
] 

Jesus Camacho Rodriguez commented on HIVE-14413:
------------------------------------------------

I need to check further, we end up in a loop because I moved HivePreFilteringRule to the PPD
block to cover more cases, and it interacts with other rules.

I've hit similar issues before; currently we might not be able to cover those additional cases
without running the rules in different blocks (as we are currently doing), but executing those
blocks multiple times (e.g. PreFil-PPD-PreFil-PPD). However, this comes with an planning time
overhead. Given that we are already trying to minimize optimization time as it might become
an issue with LLAP, we need to think carefully whether this is worth or not.

Thus, I think I will rebase the patch to cover only the DNF/CNF extension in this one, still
executing HivePreFilteringRule only once before PPD, as we were doing before. Then, we might
create a follow-up issue to discuss about merging HivePreFilteringRule with PPD block.

> Extend HivePreFilteringRule to traverse inside elements of DNF/CNF and extract more deterministic
pieces out
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-14413
>                 URL: https://issues.apache.org/jira/browse/HIVE-14413
>             Project: Hive
>          Issue Type: Improvement
>          Components: CBO
>    Affects Versions: 2.2.0
>            Reporter: Jesus Camacho Rodriguez
>            Assignee: Jesus Camacho Rodriguez
>         Attachments: HIVE-14413.01.patch, HIVE-14413.02.patch, HIVE-14413.03.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message