hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zheng Shao (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-578) Refactor partition pruning code as an optimizer transformation
Date Thu, 06 Aug 2009 18:19:14 GMT

    [ https://issues.apache.org/jira/browse/HIVE-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12740181#action_12740181

Zheng Shao commented on HIVE-578:

We should add a separate parameter to enable the new partition pruner.

Since the new partition pruner works only when ppd is enabled, we should have 3 possible modes
instead of 4.
hive.opt.ppd=false, hive.partition.pruner=ast
hive.opt.ppd=true, hive.partition.pruner=ast
hive.opt.ppd=true, hive.partition.pruner=opt

> Refactor partition pruning code as an optimizer transformation
> --------------------------------------------------------------
>                 Key: HIVE-578
>                 URL: https://issues.apache.org/jira/browse/HIVE-578
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.3.0
>            Reporter: Ashish Thusoo
>            Assignee: Ashish Thusoo
>         Attachments: patch-578.txt, patch-578_1.txt, patch-578_2.txt
> Some bugs with partition pruning have been reported and the correct fix for many of them
is to rewrite the partition pruning code as an optimizer transformation which gets kicked
in after the predicate pushdown code. This refactor also uses the graph walker framework so
that the partition pruning code gets consolidated well with the frameworks and does not work
on the query block but rather works on the operator tree.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message