hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1209) Port POJoinPackage to proactively spill
Date Tue, 09 Feb 2010 18:33:28 GMT

    [ https://issues.apache.org/jira/browse/PIG-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831578#action_12831578
] 

Olga Natkovich commented on PIG-1209:
-------------------------------------

The current unit tests adequately cover the testing of this internal change. Additionally,
Ashutosh ran several e2e tests and also verified that this change fixed user problem. User
script no longer ran out of memory

> Port POJoinPackage to proactively spill
> ---------------------------------------
>
>                 Key: PIG-1209
>                 URL: https://issues.apache.org/jira/browse/PIG-1209
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Sriranjan Manjunath
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.7.0
>
>         Attachments: pig-1209.patch
>
>
> POPackage proactively spills the bag whereas POJoinPackage still uses the SpillableMemoryManager.
We should port this to use InternalCacheBag which proactively spills.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message