hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1209) Port POJoinPackage to proactively spill
Date Fri, 29 Jan 2010 21:27:34 GMT

    [ https://issues.apache.org/jira/browse/PIG-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12806504#action_12806504

Olga Natkovich commented on PIG-1209:

The change would require stitching from old style spillable bags to the new one implemented
by Ying. Testing would be a bit tricky. I think Pradeep had some ideas

> Port POJoinPackage to proactively spill
> ---------------------------------------
>                 Key: PIG-1209
>                 URL: https://issues.apache.org/jira/browse/PIG-1209
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Sriranjan Manjunath
>             Fix For: 0.7.0
> POPackage proactively spills the bag whereas POJoinPackage still uses the SpillableMemoryManager.
We should port this to use InternalCacheBag which proactively spills.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message