pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cheolsoo Park (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-3410) LimitOptimizer is applied before PartitionFilterOptimizer
Date Fri, 16 Aug 2013 21:27:48 GMT

    [ https://issues.apache.org/jira/browse/PIG-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13742616#comment-13742616
] 

Cheolsoo Park commented on PIG-3410:
------------------------------------

+1.

I ran both unit test and e2e test. I saw 2 failures in e2e test, but they're not related and
will open jiras for them.
                
> LimitOptimizer is applied before PartitionFilterOptimizer
> ---------------------------------------------------------
>
>                 Key: PIG-3410
>                 URL: https://issues.apache.org/jira/browse/PIG-3410
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.11.1
>            Reporter: Aniket Mokashi
>            Assignee: Aniket Mokashi
>         Attachments: PIG-3410.patch
>
>
> Consider following script-
> {code}
> hcat_load = LOAD 'X' using org.apache.hcatalog.pig.HCatLoader();
> hcat_filter = FILTER hcat_load BY (part='Y');
> hcat_limited = limit hcat_filter 5;
> dump hcat_limited;                     
> {code}
> This script is not benefited from LimitOptimizer (pushing limit to loadfunc) because
LimitOptimizer is applied before PartitionFilterOptimizer. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message