hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-1544) proactive-spill bags should share the memory alloted for it
Date Thu, 02 Sep 2010 18:29:53 GMT

     [ https://issues.apache.org/jira/browse/PIG-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Olga Natkovich updated PIG-1544:
--------------------------------

         Assignee: Thejas M Nair
    Fix Version/s: 0.9.0

> proactive-spill bags should share the memory alloted for it
> -----------------------------------------------------------
>
>                 Key: PIG-1544
>                 URL: https://issues.apache.org/jira/browse/PIG-1544
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Thejas M Nair
>            Assignee: Thejas M Nair
>             Fix For: 0.9.0
>
>
> Initially proactive spill bags were designed for use in (co)group (InternalCacheBag)
and they knew the total number of proactive bags that were present, and shared the memory
limit specified using the property pig.cachedbag.memusage .
> But the two proactive bag implementations were added later - InternalDistinctBag and
InternalSortedBag are not aware of actual number of bags being used - their users always assume
total-numbags = 3. 
> This needs to be fixed and all proactive-spill bags should share the memory-limit .

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message