Return-Path: X-Original-To: apmail-pig-dev-archive@www.apache.org Delivered-To: apmail-pig-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D19F517A28 for ; Wed, 3 Jun 2015 23:54:39 +0000 (UTC) Received: (qmail 4766 invoked by uid 500); 3 Jun 2015 23:54:39 -0000 Delivered-To: apmail-pig-dev-archive@pig.apache.org Received: (qmail 4705 invoked by uid 500); 3 Jun 2015 23:54:39 -0000 Mailing-List: contact dev-help@pig.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@pig.apache.org Delivered-To: mailing list dev@pig.apache.org Received: (qmail 4689 invoked by uid 500); 3 Jun 2015 23:54:39 -0000 Delivered-To: apmail-hadoop-pig-dev@hadoop.apache.org Received: (qmail 4686 invoked by uid 99); 3 Jun 2015 23:54:39 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Jun 2015 23:54:39 +0000 Date: Wed, 3 Jun 2015 23:54:39 +0000 (UTC) From: "Rohini Palaniswamy (JIRA)" To: pig-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (PIG-4587) Only apply isFirstReduceOfKey for Skewed right outer join MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Rohini Palaniswamy created PIG-4587: --------------------------------------- Summary: Only apply isFirstReduceOfKey for Skewed right outer join Key: PIG-4587 URL: https://issues.apache.org/jira/browse/PIG-4587 Project: Pig Issue Type: Bug Reporter: Rohini Palaniswamy Assignee: Daniel Dai Fix For: 0.16.0 PIG-4377 introduced isFirstReduceOfKey to avoid extra records in case of over sampling. But the issue can occur only in the case of right outer join. But it is added to the plan in MRCompiler and TezCompiler (PIG-4580) for both left and right outer joins. We need to remove that extra check for right outer join. It is unnecessary performance penalty. -- This message was sent by Atlassian JIRA (v6.3.4#6332)