pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-1544) proactive-spill bags should share the memory alloted for it
Date Thu, 03 Mar 2011 01:23:36 GMT

     [ https://issues.apache.org/jira/browse/PIG-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Olga Natkovich updated PIG-1544:
--------------------------------

    Fix Version/s: 0.10

> proactive-spill bags should share the memory alloted for it
> -----------------------------------------------------------
>
>                 Key: PIG-1544
>                 URL: https://issues.apache.org/jira/browse/PIG-1544
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Thejas M Nair
>            Assignee: Thejas M Nair
>             Fix For: 0.10
>
>
> Initially proactive spill bags were designed for use in (co)group (InternalCacheBag)
and they knew the total number of proactive bags that were present, and shared the memory
limit specified using the property pig.cachedbag.memusage .
> But the two proactive bag implementations were added later - InternalDistinctBag and
InternalSortedBag are not aware of actual number of bags being used - their users always assume
total-numbags = 3. 
> This needs to be fixed and all proactive-spill bags should share the memory-limit .

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message