pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cheolsoo Park (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (PIG-3461) Rewrite PartitionFilterOptimizer to make it work for all the cases
Date Thu, 10 Oct 2013 20:11:42 GMT

    [ https://issues.apache.org/jira/browse/PIG-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13791933#comment-13791933
] 

Cheolsoo Park edited comment on PIG-3461 at 10/10/13 8:10 PM:
--------------------------------------------------------------

I just committed PIG-3510 to 0.12 branch. 

Regarding seriousness, this doesn't make jobs fail, but it definitely has production impact
since it makes jobs run longer. I would vote for another RC, but if we can release 0.12.1
soon enough after 0.12.0 is out, that'll be fine too.


was (Author: cheolsoo):
I just committed PIG-3510 to 0.12 branch. 

Regarding seriousness, this doesn't make jobs fail, but it has definitely had production impact
since it make jobs run longer. I would vote for another RC, but if we can release 0.12.1 soon
enough after 0.12.0 is out, that'll be fine too.

> Rewrite PartitionFilterOptimizer to make it work for all the cases
> ------------------------------------------------------------------
>
>                 Key: PIG-3461
>                 URL: https://issues.apache.org/jira/browse/PIG-3461
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.11.1
>            Reporter: Aniket Mokashi
>            Assignee: Aniket Mokashi
>             Fix For: 0.12.0
>
>         Attachments: PIG-3461-2.patch, PIG-3461-4.patch, PIG-3461-6.patch
>
>
> Current algorithm for Partition Filter pushdown identification fails in several corner
cases. We need to rewrite its logic so that it works in all cases and does the maximum possible
filter pushdown.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message