Return-Path: X-Original-To: apmail-pig-dev-archive@www.apache.org Delivered-To: apmail-pig-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E51CB105BC for ; Thu, 10 Oct 2013 20:11:44 +0000 (UTC) Received: (qmail 19450 invoked by uid 500); 10 Oct 2013 20:11:43 -0000 Delivered-To: apmail-pig-dev-archive@pig.apache.org Received: (qmail 19341 invoked by uid 500); 10 Oct 2013 20:11:43 -0000 Mailing-List: contact dev-help@pig.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@pig.apache.org Delivered-To: mailing list dev@pig.apache.org Received: (qmail 19324 invoked by uid 500); 10 Oct 2013 20:11:43 -0000 Delivered-To: apmail-hadoop-pig-dev@hadoop.apache.org Received: (qmail 19318 invoked by uid 99); 10 Oct 2013 20:11:42 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Oct 2013 20:11:42 +0000 Date: Thu, 10 Oct 2013 20:11:42 +0000 (UTC) From: "Cheolsoo Park (JIRA)" To: pig-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Comment Edited] (PIG-3461) Rewrite PartitionFilterOptimizer to make it work for all the cases MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/PIG-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13791933#comment-13791933 ] Cheolsoo Park edited comment on PIG-3461 at 10/10/13 8:10 PM: -------------------------------------------------------------- I just committed PIG-3510 to 0.12 branch. Regarding seriousness, this doesn't make jobs fail, but it definitely has production impact since it makes jobs run longer. I would vote for another RC, but if we can release 0.12.1 soon enough after 0.12.0 is out, that'll be fine too. was (Author: cheolsoo): I just committed PIG-3510 to 0.12 branch. Regarding seriousness, this doesn't make jobs fail, but it has definitely had production impact since it make jobs run longer. I would vote for another RC, but if we can release 0.12.1 soon enough after 0.12.0 is out, that'll be fine too. > Rewrite PartitionFilterOptimizer to make it work for all the cases > ------------------------------------------------------------------ > > Key: PIG-3461 > URL: https://issues.apache.org/jira/browse/PIG-3461 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: 0.11.1 > Reporter: Aniket Mokashi > Assignee: Aniket Mokashi > Fix For: 0.12.0 > > Attachments: PIG-3461-2.patch, PIG-3461-4.patch, PIG-3461-6.patch > > > Current algorithm for Partition Filter pushdown identification fails in several corner cases. We need to rewrite its logic so that it works in all cases and does the maximum possible filter pushdown. -- This message was sent by Atlassian JIRA (v6.1#6144)