pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rohini Palaniswamy (JIRA)" <j...@apache.org>
Subject [jira] [Created] (PIG-4587) Only apply isFirstReduceOfKey for Skewed right outer join
Date Wed, 03 Jun 2015 23:54:39 GMT
Rohini Palaniswamy created PIG-4587:
---------------------------------------

             Summary: Only apply isFirstReduceOfKey for Skewed right outer join
                 Key: PIG-4587
                 URL: https://issues.apache.org/jira/browse/PIG-4587
             Project: Pig
          Issue Type: Bug
            Reporter: Rohini Palaniswamy
            Assignee: Daniel Dai
             Fix For: 0.16.0


PIG-4377 introduced isFirstReduceOfKey to avoid extra records in case of over sampling. But
the issue can occur only in the case of right outer join. But it is added to the plan in MRCompiler
and TezCompiler (PIG-4580) for both left and right outer joins. We need to remove that extra
check for right outer join. It is unnecessary performance penalty.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message