pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rohini Palaniswamy (JIRA)" <j...@apache.org>
Subject [jira] [Created] (PIG-5083) CombinerPackager uses twice the memory due to materializing of bags
Date Fri, 06 Jan 2017 21:34:58 GMT
Rohini Palaniswamy created PIG-5083:
---------------------------------------

             Summary: CombinerPackager uses twice the memory due to materializing of bags
                 Key: PIG-5083
                 URL: https://issues.apache.org/jira/browse/PIG-5083
             Project: Pig
          Issue Type: Bug
            Reporter: Rohini Palaniswamy
            Assignee: Rohini Palaniswamy
             Fix For: 0.17.0


Before PIG-3591 and creation of CombinerPackager, POCombinerPackage directly read from the
combiner/reducer input instead of materializing the bag.

https://github.com/apache/pig/blob/branch-0.12/src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCombinerPackage.java#L140-L161



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message