hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thejas M Nair (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1447) Tune memory usage of InternalCachedBag
Date Thu, 19 Aug 2010 20:26:17 GMT

    [ https://issues.apache.org/jira/browse/PIG-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12900435#action_12900435
] 

Thejas M Nair commented on PIG-1447:
------------------------------------

I am wrong about multi-query being a big cause for concern in raising this parameter value
- the sub-plans for each query in multi-query are executed one at a time for a given tuple
with large bags. So the number of large bags that can't be garbage collected would be similar
to that of single query. 15% default value seems to be reasonably safe.



> Tune memory usage of InternalCachedBag
> --------------------------------------
>
>                 Key: PIG-1447
>                 URL: https://issues.apache.org/jira/browse/PIG-1447
>             Project: Pig
>          Issue Type: Improvement
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Daniel Dai
>            Assignee: Thejas M Nair
>             Fix For: 0.8.0
>
>         Attachments: L15_modified.pig, L15_modified2.pig
>
>
> We need to find a better value for "pig.cachedbag.memusage".

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message